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ABSTRACT 

Upper and lower bounde on the inherent computational complexity of 
the decision problem for a namber of logical theories are established. 

A general form of Ehrenfeuefct game technique for deciding theories 
is developed which involves analysing the expressive power of formulas 
with given quantifier depth. The method allows one to decide the truth 
of sentences by limiting quantifiers to range over finite sets. In 
particular for the theory of integer addition an upper bound of space 

2 cn 
2 is obtained; this is close to the known lower bound of nondeterministic 

2 c'n 

time 2 

A general develop men t of decision procedures for theories of product 

structures is presented, which allows one to conclude in most cases that 

if the theory of a structure is elementary recursive, then the theory 

of its weak direct power (as well as other kinds of direct products) 

is elementary recursive. In particular, for the theory of the weak 

direct power of ^.-t** , and hence for integer multiplication, an upper 

cn 

2 
bound of space 2 is obtained. The known lower bound is nondeterministic 

,c'n 

2 

time 2 

Finally, the complexity of the theories of pairing functions is 
discussed, and it- is shown that no collection of pairing functions 
has an elementary recursive theory. 
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Chapter 1: Introduction and Background 
Section 1; Introduction 

The significance of the distinction between decidable and 
undecidable theories has been blurred by recent results of Meyer and 
Stockmeyer [Mey73,MS72,SM73,Sto74] and Fischer and Rabin [FiR74] who 
have shown that most of the decidable theories known to logicians 
cannot be decided by any algorithm whose computational complexity grows 
less than exponentially with the size of sentences to be decided. In 
many cases even larger lower bounds have been established. In this thesis 
we investigate the computational complexity of a number of different 
logical theories, obtaining decision procedures whose computational 
complexities roughly meet the known lower bounds and deriving a 
new lower bound whose complexity is very close to the known upper 
bound . 

Let N be the set of noimegative integers. Whether a sentence of 

the first order theory of N under addition is true is decidable 

according to theorem of Presburger [Pre29]. A more efficient decision 

procedure given by Cooper [Coo72] has been proved by Oppen [Opp73] to 
2 en 



require only 2^ steps for sentences of length n, where c is 



some 



constant. In Chapter 2 we present a fairly general development of 

2 cn 
Ehrenfeucht games [Ehr61] which allows us to show that space 2 is 

sufficient for deciding Presburger arithmetic. 

Let N be the set of functions from N to N of finite support, i.e., 

N = [f: N-»N | f(i) = for all but finitely many i 6 N} . 



-6- 

The structure < N ,• > of positive integer* under multiplication is 

isomorphic to the structure < N , + > (the weak direct power of < N, + >) 

where addition is defined component-wise. The first order theory of 
this structure is known to be decidable by a theorem of Mpstovski [Mos52]. 
Mostowski's procedure, however, is not elementary recursive in the 
sense of the following definition: 

Definition l t l; An elementary, '• cars lY e f^Uffi? <« •triags or integers) 
is one which can be com p u ted by some Turing Machine within time bounded 
above by a fixed composition of exponential functions of the length of 
the input. (This is shown by Cobham {Cob64] and Ritchie |Elte3] to 
be equivalent to Kalmar's definition fcf. *et6714 

In Chapter 3 we use the technique of Ehrenfeucht games to derive 
some general results about the theories of weak direct powers which 

enable us to obtain a new procedure for deciding whether sentences are 

* 
true over < N , + >. Our procedure can be implemented on a Turing machine 

,cn 2 c ' n 

2 2 2 2 

which uses at most 2 tape squares (and hence 2 Steps) on 

sentences of length n. As a corollary we obtain the same upper bound on 

decision procedures for the first order theory of finite abelian groups. 

Recent results of Fischer and Rabin [FiR74] show that for some constant c" > 0, 

any procedure for the first order theory of < H , + > requires time 

9 c"n 

2 
2 even on nondetermlnlstic Turing machines. Thus (see Sections 2 and 3) 



the worst case behavior of our procedure for < N , + > is assymptotically 
nearly optimal in its computational requirements. 

In Chapter 4 we extend the methods of Chapter 3 in order to obtain 
general results relating the complexities of theories to the complexities 
of their weak direct powers and direct products, thereby obtaining 
computational versions of results of Mostowski [Mos52] and Feferman 
and Vaught [FV59]. In particular we show that the theory of the weak 
(or strong) direct product of a structure is elementary recursive jLf 
(but not only if) the theory of the structure is elementary recursive and 
if another condition holds; this other condition says roughly that not 
too many sets of k-tuples can be defined in the structure with 
quantifier depth n formulas. 

Chapter 5 is concerned with the computational complexity of pairing 
function structures. A pairing function is a one-one map P: N X N -» N, 
and the associated structure is < N,p >. Although the theory of the 
set of all pairing functions is undecidable and the theories of some 
individual pairing functions are undecidable, Tenney [Ten74] shows 
that many commonly used ones have decidable theories. Our main result 
is that no nonempty collection of pairing functions has an elementary 
recursive theory. In fact, for some constant c > 0, the theory of 
any nonempty collection of pairing functions requires time 2 2 " ^ height en 
to decide. 

In Section 2 of this chapter we present the definitions and basic 
theorems of automata theory needed to clarify the basic notions of 
upper and lower time and space bounds used in the following chapters. In 



Section 3 we discuss the reducibility techniques which allow us to 
achieve many of the upper and lower bounds. Section 4 consists of 
a description of the notation and fundamental concepts of mathematical 
logic which will be needed in the rest of the thesis. 
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Section 2; Automata Theory Background 

We shall consider a version of Turing machines which may be either 
deterministic or nondeterministic, one tape, one- head automata, 
with a finite tape alphabet £. For a rigc*oua s 4ftfiftition of these 
machines the reader can consult [Sto74, Section 2.2]. For most of our 
purposes, however, the exact details of the definition chosen do not 
matter very much, so we provide only an informal description, here. 

The tape is one-way infinite to the right and the automaton starts 
in the initial state with its head on the leftmost square of the tape. 
At any step, depending on the current state and the -current contents of 
the tape square scanned by the head, the automaton -cm write a new 
member of £ on that square, move the head right or .-leffc, and go into a 
new state. The Turing machine- Is., deterministic, if its actions at any 
step are completely determined by its state and by the contents of the 
square pointed at by the head. If the machine &» ^e nd«l;er«iiligtic 
there may be a finite set of permissible act tons possible at any moment. 
Thus, the deterministic Turing machines form a subset of the nondeterministic 
ones. -n ex 

A (deterministic or nondeterministic) £- automaton 5$ has 2 as the tape 
alphabet; at any moment, all the symbols on the tape are from the 

alphabet S, V € E. Let 2 be the set of all finite sequences, or 

+ * 
"strings" of elements of S and let E = £ - {*.} where \ is the empty 

string. If y € E + , then 3» accepts ~y Af there is some sequence of possible 

steps of SJtwith the tape squares initially containing the string yM • •• 

and the head scanning the leftmost symbol of Y. Chat ends with an 
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aceepting state. The set L(M) - { y € ZT I 3R accepts y} i» called the 
language recognised by Stt . 

We now define vfcat weus by the tine end apace need by Taring 



machines. If ii» » (nomrfater*iniafcic> ^-Turing wertriTie efej^ch accept* 
y € £ by sone computation cantrajping at aunt n steps then we say that 



SK accepts y vlthln tlae n. If 91 accepts y by seas) computation during 
which the head visits at Most n different tape square* then we say that 
3B accepts y within space n. Let L - L#% and: let f: » -♦ M. Then we 
say 3d recognises L within tine (space) €<n) if ier every ,v € L,. 3* 
accepts y within tine ^npaee) £ (IyI) where iyj is the length ©€ the 
string y. NTIMBff #*>> 0»SPACK(f (n)» ia the set of languages (where 
by language here we swan a subset of W £nr sow alphabet £) each of 
which is recognised by some nondeterninistie Turing machine within 
tine (space) f(n). DTItg(f(n)> and DSPACE(f(n)) are defined similarly 
with respect to deterministic machines. - 

In order to compare the upper and lower bounds for the computational 
complexity of the theories we shall consider, it is necessary to understand 
certain relationships known to hold between tine and space for deterainistlc 
and nondeterninistie computations. ( These natters are dl scu aeed more fully 
in [Sto74}.> 

Fact 2. I t, Let f : N "■* ». 

A. Nondeterninistie versus deterministic tine 

a> DTlMB(f(n)> S 8TJMB(f (n» 

b) NTIMB(f(n)> c UbTBffi(c f<n) ). 
cQi 
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B. Nondeterministic versus deterministic space 

a) DSPACE(f(n)) c NSPACE(f(n)) 

b) NSPACE(f(n)) = DSPACE((f(n)) 2 ) 

C. Time versus space 

a) DTIME(f(n)) c DSPACE(f(n)) 
NTIME(f(n)) £ NSPACE(f(n)) 

b) NSPACE(f(n)) £ UDTIME(c f (n) ) 

c€N 

All of Fact 2.1 is relatively straightforward to prove, with the 

exception of B.b. B.b is proved by Savitch [Sav72]. By (B) , if we 

en 
are discussing a lower or upper bound of the form "space 2 for some 

constant c" it is unnecessary to specify if we are talking about deterministic 

or nondeterministic space. Similarly, we can talk about a bound of the 



■7 

,.* <hei| 
"2 J 



jight en M 

form "2' J for some constant c without specifying if we are 

talking about time or space, either deterministically or nondeterministically. 

Each of the gaps between a) and b) in A, B, C above represent 
important open questions of automata theory. 
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Section 3: Using Redaclbillties to Prove TJftmt and Lower Bounds 

+ 
Definition 3,1 : Let L. and £ 2 be finite alphabets and let 1^ £ 2^ 

and L 2 £ S„. Then L. £ . L- if for some function g: L. ■+ £„: 

I) for all y € E*. y € 1^ ° g(Y> € Lg and 

II) there is some Turing machine which computes g within time a 

fixed polynomial in the length of the input and within space linear ir. 

t 
the length of the input. 

* 
If S is a collection of languages over E. (S c p(£_)), then we say 

S £ -L, if L * JL. for all L € S. 

We now state Lemma 3.2, which is a very powerful way of proving 
lower and upper bounds. For a proof (which is really very simple) of 
this fact and for a very thorough discussion of red ucibili ties, see 
[Sto74]. 

Lemma 3.2 : Say that L_ £ .Lj. Let f : N -» N. If 

(DTIME(f(n)) /DTIME(f(cn) + p(n)) 

DS?ACE(f(n)> / DSPACE(f(cn) + n) 

NTDffi(f(n)) ' then L l € 7 NTIME<f(cn) + p(n) 
NSPACE(f(n)) V, NSPACE(f(cn) + n) 

for some constant c > and polynomial p(n). 

A deterministic Turing machine computes g if when it is started with 
yW ... on its tape, y € £T, and its head on the leftmost square, it 

eventually halts and g(Y) la the string on the tape to left of the head. 
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Cantrapositively, if 

/ DTIME(f(n) + p(n)) / DTIME(fi(cn)) 

( DSPACE(f(n) + n) C D§PACE(f (en)) 

L l * J NTIME(f(n) + p(n)) then L 2 * 7 NTIME(f(cn)) 

V^ NSPACE(f (n) + n) \ NSPACE(f (en)) 

for some constant c > and some polynomial p. 

An example of the way we use Lemma 3.2 is the following: say that 
we have languages L. and L» such that we know that L 2 € SPACE(2 ) for 

2 cn 



some constant c. If L- ^ .L„ then we can conclude that L^ € SPACE(2 ) 

2 c ' n 
for some constant c. If we know that ^ £ NTIME(2 ) for some 



constant c' > 0, and if ^ ^ fa, then we can conclude that 

2 c*n t 

L 2 i NTIME(2 ) for some constant c* > 0. This latter idea is often 

used in conjunction with Lemma 3.3. 



Lemma 3.3 : (see[Co73^FM73,Sei74].) Let f : N -» N be one of the functions 

n 2 n . • ' \ 

2 n , 2 2 , 2 2 , or 2 2 * ^ ei 8 ht n e T h en there exists a language L such that 

L 6 NTIME(f(n)) and L £ NTIME(f(n/2)). 



2 n 2 2 2 .' {height n 
Theorem 3. A : Let f: N -♦ N be one of the functions 2 ,2 ,2 or 2 ) 

and let L Q = E* (for some S*) be such that NTIME(f(n)) ^ pJj L Q . Then for 

some constant c > 0, L Q $ NTIME(f (en)). 



It is easy to see that if L £ NTIME{ £<*.))» then any nondetermini»tic 
Turing machine which recognizes L takes time at least f(n) on some 
y e L of length n. for infinitely many n. 
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Proof: Say that STIME(f<n)) * fa. By Lemma 3.3, let L be such that 

L $ NTIME(f(n/2)> end L € *TIME(f(n)). So L * i^. By Lena 3.2, 

L_ j? NTIME(f(cn)) for soma constant c > 0. D 



A typical way Theorem 3.4 is used is the following. Fischer and 
Rabin [F1R74] show that if TH is the theory of integer addition, then 

NT1ME(2 ) £ .TH, concluding that TH I KTIME(2 ) for constant c. 

In Chapter 2 we show that TH € SPACE(2 ) for some constant c', and 



9 c'n 

2 
hence that TH € DTIME(2 ) for some constant c*. 

A natural question is whether or not we can get a DTIME upper 

bound for TH and an NTIM lower bound for TH which are closer to 

2 2 

each other than are 2 and 2 . If ve could, this would settle 

an Important open question of automata theory, for instance, say that 

ncta 
we could show that TH € DTIME (2^ ) for some constant c*. Since 

2° «n m* 

NTIME(2* ) * .TH, Lemma 3.2 would imply that NTlKE<2* ) 'c U DTBffi(2 ), 
pX cm 

narrowing the gap in Fact 2.1, A. This would also contradict the popular 

conjecture that (for most functions f that are encountered) there is a 
language in NTDffi(f(n)) which requires DTIME(c ( ) for some constant c. 
The reason therefore that we have not been able to narrow the gap between 
our DTIME upper bound and NTIME lower bound for TH, is not because we do 
not understand the expressive power and other properties of TH, but 
rather because we don't understand many basic properties of the very 
notions of deterministic and nondeterministic computation. 
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Section 4; Mathematical Logic B ackground and Notation; 

Most of the notation of mathematical logic that we shall use is 
fairly standard; the reader can find precise definitions of those 
concepts not defined here in [Men64]. 

£will always represent a language of the first order predicate 
calculus with a finite number of relational symbols Rj, ft_ 2 , "" -i 
where ft will be a t -place formal predicate for 1 ^ 1 ^ l. For 

technical convenience, £ will not contain function symbols. Sometimes 
we will choose £ to have a constant symbol e as well. The formal 
variables of £ are written as x Q , x^ * lQ , x u , •••. **«* **» the 

subscripts are written in binary. For expository convenience, we will refer to 

distinct formal variables as x.Xq.x^Xj, ..., y^.y^ •••> *» z » 8 i» •••» 
w,w Q ,w-, . .-, x', y ',«',... . 

The atomic formulas of £ are strings of the form JLj/v^v^ . . . ,v ) 

where v ,v 9 , ..., v represent (not necessarily distinct) formal 

variables; if £ has a constant symbol e, then each v^, 1 £ j £ i, can 

represent either a formal variable or e. We define the formulas of £ 
recursively as follows: Atomic formulas are fonmilas; if Y^ and F 2 are 

formulas and v is a formal variable, then each of the strings 



; j ;-i "^^^^r^f-'^^V:- 
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(F x V F ? ) 



(F x A 


F 2> 


(F 1 "► 


F 2> 


(F-~ 


V 


1 




-vFj 




VvF x 





t 
is a formula. We ua« the usual notions of an occurrence of a 

variable in a formula being bound or free, and define a s e n tence of 

£ to be a formula in which there are no free occurrences of variables. 

A structure for £ is a tuple S = < S, R. , . .., ft. > where S is a 

'i 
set and ft ± £ S for 1 s i s I; if £ has a constant symbol e, then a 

structure for £ is < S ft.,, . ..„ ft,, e > where e € S. We call S the 

domain of 3. If F is a sentence of £ we will use the usual notion of 
F true in 8 or S satisfies F or F holds in 8 . and we will write this 

SI- F. Sometimes we will say "F is true" or "F holds" or merely assert 
"F" when 8 is understood. TH<8) .« the theory of 8 ■= {F | F is a sentence 

and S h F). If P is a nonempty collection of structures, then define 

_ __________ _ , , 

When writing formulas we will omit parentheses when it will not lead to 
confusion. 
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TH(P) - theory of P - ^ TH(S). 

S € P 

Our language £ would have been just as powerful had we left out 
much of our logical notation. For instance x V y is equivalent to 
~x -» y and VxF is equivalent to ~€x~F. It is only for convenience 
that we have made £ as large as we have. 

We say a formula F is a Boolean combination of subformulae 
F , F 9 , ..., F, if F is obtained by combining F^ f 2 > ••>• \ 
using perhaps A, V, ->,h, ~ but no quantifiers. Clearly every formula 
is equivalent to a Boolean combination of formulas, each of which begins 
with an existential quantifier. 

We now define annotated formulas in order to be able to talk about 
substituting members of a domain for free occurrences of variables, and 
in order to be able to talk about the relations defined by formulas. Let 
F be a formula and say that we have a sequence of formal variables 
containing (not necessarily exclusively) the variables which occur 
freely in F, say x^ x 2 x^ We define the annotated formula 

F(x , x 2 , .... x^ to be, formally, the ordered pair consisting of F and 

the sequence x^ x 2 j^. Informally, when we write F^, x 2 , ..., x^ 

we think of ourselves as associating with the formula F the sequence 

x , x,, ..., x.. We will usually use F and F(x r x 2 , ..., x^ inter- 
changeably, and call them both formulas, as long as this association is 
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understood; we will never associate two different sequences with the 
same formula. 

Say that F(x- , x_, ..., x. ) is an (annotated) formula and S is a 

structure with domain S, and a. € S. By F(a 1 , x_, ..., x. ) we will mean 

the formula obtained by substituting a. for free occurrences of x. 

in F. Note that this is technically not a formula of £ but rather a 
(non-annotated) formula in the language £* obtained by adding constant 
symbols to £ for every member of S. If a.. , a 2 a. € S, then 

F(a 1 , a„, ..., a.) is defined similarly, and we write 

S I- F(a-, a 2 a.) if F(a_, a 2 , ..., a.) is true in S. 

For k > 0, we use x. to represent the k- tuple (x. , x 2 , ..., x.)» \^ 

to represent (a.. , a 2 , ..., a,), (a, , b) to represent (a-, a 2 , ..., a, , b), 

— k 

etc. Thus F(x.) will be used instead of F(x 1 , x 2 , ..., x. ), etc. e 

k 
and e will stand for the k-tuples (e, e e) and (e, e_, ..., e). 

k k 

S is the set of k-tuples of members of S. (S is isomorphic to the set 

of functions from {0, 1, 2, ..., k-1} to S.) For k * 0, S is taken to 

— k 
be the singleton set containing the empty set, and a, , e , etc., 

denote the empty set. However, we take (a, ,b,c) to mean (b,c) when k = 0, etc. 
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If we write F(x.) when k - 0, then F is a sentence; F^), H\) , etc., 

are in this case no different than F itself. 

k • ■" 
If S is a structure with domain S and A c S and FC^) is an 

annotated formula, then we say F defines A In 8 if 
A = j~ t s k | g j. F(a.)}. We say "F defines A M if 8 is understood. 
More generally, say that we are interested in a particular nonempty 
class of structures P. By a k-place property G we mean a function which 
assigns to each structure S € P a subset of S (where S is the domain of 
g); we will usually refer to the value of G on & as the relation G 
restricted to 3 . If \ € S k , then we write S h 6(1^) to mean that 1^ € 

the relation obtained by restricting G to S. When 6 is a property we 
sometimes write G^) to indicate that G is a k-place property. If 
G(x.) is a formula, we say that G defines G in P if in every 8 € P, 
G defines G restricted to S. We say "G defines G" when P is understood. 

Formulas F. and F 2 are equivalent in S if for some sequence 
x r x , ..., x^ of variables, the free variables of both F x and F 2 are 
from among x r x 2 , ..., x fc , and the annotated formulas F^) and F^) 
define the same subset of S k . F 1 and F 2 are equivalent in P if they are 
equivalent in every member of P. We say "F 1 and F 2 are equivalent" to 
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mean with respect to the class of all structures, unless 8 or P 
is understood. 

Since we shall be interested in Turing machines whose input 
strings are sentences of Z, we have to have a precise notion of the 
alphabet used to write formulas and a precise notion of the length of 
formulas. Our alphabet consists of £ <■ {(, ), A, V, ■*,*"*» 3, V, R, x, 0, 1,] 

(where and 1 are used to write subscripts of variables and relation 
symbols) ; if e is a symbol of £, then e € L also. If F is a formula, then 
by the length of F, written |f|, we will simply mean the length of F as 
a member of £ • 

Another usage of the notation F(x., x 2 , ..., x. ) serves to 

emphasize that the free variables of F are from among x- , x 2 , ..., x.. 

For instance, the more mnemonic notation 3x,F(x. ) will sometimes be 

used instead of 3x-F. If we write |f(x. )| we simply mean |f|. 

Notation : If or is a string, then | a\ is the length of cr. If or is a set, 
then |a| is the cardinality of a. If a is an integer, then | a| is the 
absolute value of a. N is the set of positive Integers. For i € N , 
Q will always represent a quantifier, i.e., either V or 3. All 
logarithms are to the base 2. 

Definition 4.1 : A formula F is in prenex normal form i f it is of the 
form QjVjQo^ ••• ^k v v F ' w * iere *" is quantifier free and v-, v 2 , ..., v. 
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represent formal variables. 

Theorem 4.2 : Every formula F is equivalent to a formula G in prenex 
normal form such that G has at most |f| quantifiers and is of length 
at most | f| • logj F | . Furthermore, there is a procedure (i.e., Turing 
machine) which given F computes G within time polynomial in |f|. 

Proof : There is a standard procedure for converting a formula to one in 
prenex normal form [Men64]. The procedure basically just "pulls out" 
the quantifiers to the front, except that first the names of certain 
variables have to be changed in order for the procedure to produce a 
formula equivalent to the initial one. The procedure does not change 
the number of quantifiers, so G has at most |f| quantifiers. F has at 
most |f| occurrences of variables, so if these are given all different 
names (in the worst case) and the binary subscripts are chosen to be 
as short as possible, then F grows by a factor of at most log |f| when 
put in prenex normal form. This procedure can be checked to operate 

i — ! 

within polynomial time. 

Thus, to show that a theory can be decided within space f(cn) for 
some constant c, where f grows faster than polynomial ly, it is 
sufficient to give a procedure which decides the truth of prenex normal 
form sentences of length at most n log n with at most n quantifiers, 
within space f(cn) for some constant c. 
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Definition 4.3 : If F is a formula, we will write q-depth(F ) to mean 
the quantifier depth of F. Formally, if F is an atomic formula then 
q-depth(F) =0; if F, and F„ are formulas then 

q-depth^ V F 2 ) = q-depth^ A F 2 ) = q-depth(F 1 -» F 2 ) = q-depth^ *■» F 2 ) 

Max{q-depth(F ), q-depth(F 2 )} , q-depth(~F.,) = q-depth(F-) , and 

q-depth(3vF 1 )= q-depth(VvF 1 )= 1 + q-depth(F 1 ) . 
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Chapter 2: Ehrenfeucht Games and Decision Procedures 

Section JL: Introduction 

In this chapter we present a development of the Ehrenfeucht game ap- 
proach to deciding logical theories. This approach was originally 
described in [Ehr61] , and in particular the reader may wish to consult 
this source to learn about the relationship to game theory. A discussion 
of game theory also appears in work by Richard Tenney [TenTAjTenyA' ] - Tenney 
uses Ehrenfeucht game techniques to decide the theories of certain 
pairing functions and to decide the second order theory of an equivalence 
relation. Neither Ehrenfeucht nor Tenney explicitly describes these 
techniques in generality. We shall present a development in this chapter 
which, although not completely general, is general enough to handle a 
wide variety of cases. Where possible we will describe our decision 
procedures in terms of bounds on quantifiers, so that to decide the truth 
of a sentence one need only decide the sentence when each quantifier is 
limited to range over a particular finite set. This idea, which will be 
carefully described in the next three chapters, is also used by Tenny, 
Ferrante and Rackoff [FR74] , and Ferrante [Fer74]. In addition, as part 
of our development of the Ehrenfeucht game approach we shall characterize 
it in terms of the quantifier depth of formulas. 

Section 2 of this chapter consists of a general development of 
Ehrenfeucht games. Our approach is somewhat different from that of 
Ehrenfeucht or Tenney, but several of the basic theorems and ideas come 
from these sources. In Section 3 we derive a decision procedure for 
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the first order theory of integer addition as a corollary of our 
general development. In Section 4 we discuss an important open 
question relating the complexity of decision procedures to the index 
of the equivalence relation which characterizes Ehrenfeucht games. 
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Section 2 : The Ehrenfeucht Equivalence Relation and Ehrenfeneht Games 

Let Z be a fixed language of the first order predicate calculus 

with finitely many relational symbols ft ,ft 2 , . . . ,ftg where ^ Is a t^- 

place formal predicate for l^i^X. Also, let £ have a single constant 

symbol e. Let S=<S, ftj,^,. .. ,ft x ,e> be a fixed Structure for Z. 

(Actually, the constant symbol e plays no important role in this chapter 

but is Included so that we can talk about weak* direct powers later.) 

In addition we will assume we have a norm on S, by which we mean a 

function || ||:S-*N, and we will denote the norm* of a € S by ||a||. 

If i€ N, then we write a<i to mean | |a{| si. We introduce this concept 

of norm in order to describe simple decision procedures which use space 

efficiently (and without a significant time loss). However the reader 

should note that many of the theorems below make no mention of the norm 

and are Independent of this notion. 

We now define the Ehrenfeucht equivalence relation. 
Definition 2.1 : For all n,k€ N and all a^b^ S k , define a^ = b fc iff 

for every formula FO^) of q-depthsn, F(a fc ) and F(b k ) are either both 

true or both false (in S). 

Remark 2.2 : For each n,k£N, - is an equivalence relation on S . 
Ehrenfeucht originally defined = by induction on n; his definition 
consisted of a combination of our definition of g together with what 
we call Theorem 2.3. We will prove this theorem later. 

_ - v _ _ 
Theorem 2.3 : Let n,k€N and a^k^S • ' aien \ ^ \ ** 

1) For each a, - € S there exists some \ +1 € s such tnat \+i n b k+l* 
and 2) For each b, €s there exists some \ +1 ^ s such tnat \ + i n \+l* 
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- - k 
Lemma 2.4 : Let n,k € N and a.,b. € S such that 

1) For each a fc+1 € S there exists some t> k+1 € s such that a fe+1 = \ +l ' 
and 2) For each b. . .€ S there exists some \ +1 ^ s 81ich tnat \ + i n b k+l* 

^l *k nil V 

Proof : Say that 1) and 2) hold. Since every formula is equivalent to 

a Boolean combination of formulas each of which begins with an existential 

quantifier, it is sufficient to prove, for Ffc^) of the form Hx^ GCx^) 

where q-depth(G) in, that F (5^) «» F (5^). 

So assume that FCa^) holds. Then let a^ € S be such that GCa^) 
holds. By 1), let b fc+1 € S be such that S^ » b^. Since G(a fcfl ) is 
true, G(b, .) is true (by definition of g), so FCb^) is true. By 
symmetry, ?(\) holds if F(b k ) holds. D 

Definition 2.5 : For each n,k€^ let M(n,k) be the number of equivalence 

classes of = restricted to S . 
n 

- k 

Lemma 2.6 : Let n,k€N. Then M(n,k) is finite and for each a^S there 

<• r k 

is a formula F(x.) of q-depth n such that for all b, €s , 

SHF(b ) » b. s a, (i.e., F defines the = equivalence class of a.). 

— k ~ 

Proof (by induction on n): If n«0 and \€$ , we can clearly take $t\) 

to be a conjunction of atomic formulas and negations of atomic formulas. 

Since an argument place of an atomic formula can be occupied by either a 

formal variable or by <», the number of atomic formulas in which at most e, 

*> t 

x ,x_,...,x, occur is ,E. (k+1) *•. So 

,S(k+l) 1 
M(0,k)^2 1 X 



^^^^0^¥^^i 
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Now assume the lemma true for n (and, all k). We shall prove it for 

n+1 (and k). Let F^^.Fj^),.. .^(n.k+l)^^ be & **^ ce of 
formulas of q-depth n such that for each \ +1 € S there exists an 1, 
1 £i*M(n,k+l), such that ¥ ± defines the | equivalence class of a^. 



For each c, € S define 
k 



W(c k Ml | liiSM(n,kfl) and 3x fc+1 F^c^x^) is true}. We shall show 
that for all b k ,c k €s k , \ ^ * k « W^^k?' ■ ThUS the foraul * F <*k )= 



A 

itW(c k ) 



/ \ la:iSM(n,k+l) 



*■*! F i < Vl» A "{Jt: , a *Sc + l' F l ( Wl 



defines the = equivalence class of ev., ',....:„ 

Clearly if b fc ^ c fc , then W^-tf (c^) since each formula 

gv f ( i. ) is of q-depth n+1. To prove th? converse we first prove 
the following Claim. 

Claim ; If W(b k )=W(c k ), then for each c k+1 €s there exists some t> k+1 € S 
such that c k+1 = b k+1 (and by symmetry, for each i» fcfl ' € '.S there 'exists - 
some c k+1 €s such that c k+1 = b^). 

Proof of Claim : Say that W(b\>W(c k ) and Cfc+1 € S. Let i, 15UM(n,k+l), 
be such that ^O^.,) defines the = equivalence class of c fc+1 . ^(c^) 
is true, so a x k+1 F 1 (c k ,x k+1 ) is true, »o i€w^). So i€W(b k ). This 
means that Sk,^ F ± ( t> k ,x k+1 ) is true, and therefore we can find b fc+1 such 
that ^(b^) ie true. Sine* F ± defines the * equivalence claas of c^j, 
we mnat have ^ = b k+r 

By the Claim and Lemma 2.4, W(b k ^«*?(c k > » \ nil V tote that the 
s, equivalence class of c fc is determined by W(c^) which is a subset of 
{l,2,...,M(n,k+l)}. So M(n+l,k)*2 M(n » k+1) . This and the bound on M(0,k) 
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2 (n+k) c 



.* I height n+1 
(n,k) * 2 2 " J 



imply that M(n,k) £ 2 J for some constant c. D 

Remark 2.7 : There are structures S such that 
2 n4k 

.* I height Cn 

M(n,k)2:2 i (for seme constant C > 0) , so M(n,k) is not in 

general bounded above by an elementary recursive function. For many 

structures, however, M(n,k) grows considerably more slowly. 

Definition 2.8 : Let H:n -*N be a function which is nondecr easing in each 
argument. Then S is H-bounded iff for all n,k€N and all: F^S^) of 
q-depthsn and all a. € S , if a *i c+ i F (\» x i c+ .i^ ls true in 8 then 
[ax k+1 <H(n,k, i g| k {||a i l|}) ]F(\»« k+1 ) *« true in S. (We take Max ;.* 
to be 0.) 

Remark 2.9 : If our norm on S is the identically function and H:n -»N 
is the identically function then clearly S is H-bounded. This means that 
often when we have a theorem which involves the concepts of norm and 
H-boundedness, we can immediately obtain a simpler theorem which doesn't 
mention those concepts; sometimes, as is the case with Lemma 2.10, this 
new result is still interesting. 

Lemma 2.10 : Let H:1T-»N be such that S is H-bounded. Let n,k € N and 

- - /- k - - ■/- 

let a.,b, tS such that a. =- b,. Then for each a, - c 3 there exists 

some b, j6 s such that a... = b, and such that 

||b k+x ||^H(n,k, i ^x k {||b i ||}). 
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- - k ~ r 

Proof : Let a, ,b,€ S such that a, =. b,. Let a, c S. By Lemma 2.6 
there is a formula F(JL ) of q-depth n which defines the = equivalence 
class of a k+1 . Since 3*^ F( \,^ +l ) is true and ^ ^ b k , 
3x, - F(b ,x, .) is true. Since § is H-bounded, we can choose b k+1 ^ s 
such that F(b k+1 ) is true and l|b k+1 H s=H(n,k, Max { | ^ | | } ). But 
F(b k+1 ) implies b k+1 = a k+1 . □ 

Proof of Theorem 2.3 : Theorem 2.3 follows immediately from Lemma 2.10 
(keeping in mind Remark 2.9) and Lemma 2.4. □ 

H-boundedness of a structure guarantees that quantifiers in a 
formula ranging over all of S can be replaced by quantifiers ranging 
over elements of S whose norms are bounded by a function determined by H. 
This is made precise in the following lemma. 

Lemma 2.11 : Let H:tT-*N be such that S is H-bounded. Let n,k € N and 
let Q x Q 2 x 2 ...Q. x^ F( x, ) be a sentence of £ with q-depth £ n+k , i.e., 
q-depth(F) ^n. Let m,€ IT be a sequence such that m. ^ H(n+k-i,i-l, Max (m .} ) 

for 1 £ i £k. 

Then Q x . Q.-,x ? . . . Q x, F( O is true « 

(Q 1 x 1 <m 1 )(Q 2 x 2 «m 2 )...(Q k x k <m k )F(x k ) is true. 

Proof : Consider the formula Q„x„ Q„x_ . . . Q. x, F( x, ). Because S is 
H-bounded, if m ^H(n+k-l,0,0) then Q x-(Q 2 x 2 . . . Osc F( x^) ) is equivalent 
to (Q i x 1 <m 1 )(Q 2 x 2 ...Q k x k F(x k )). 

Now for each a^S such that | |a| | ^m , consider the formula 

Q,x_ Q,x, . . .Q x-F( a,x 2 ,x„ x^) . Because § is H-bounded, if 

m 2 ^HCn+k-2,1^) then Q 2 x 2 (Q 3 x 3 . . .Q k x k F( a,x 2 ,x 3> . . . ,x k >) is equivalent 
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to (Q 2 X2 <m 2^ Q 3 x 3*" Q k 3c k F(a,X 2 ,X 3* , * ,,X k^* Heace » 
(Q x 1 <m 1 )Q 2 x 2 ...Q k x k F(x k ) is equivalent to 

<Ql*l < "i> «*2*2 <B 2 ) V3" 'Vk F( *k )# 

By k-2 additional applications of the H-boundedness of &, we arrive 

at Lemma 2. 11, □ 

We now demonstrate the existence of a general method of proving 
H-boundedness. 

Lemma 2.12 ; Let H:tT-»N be a function which is nondecreasing in each 

argument, and say that for each n,k € N we have an equivalence relation 

k 
E on S satisfying the following properties: 

1) For all fc€» and all « k »£| t € S k , \ E (J \ ** \ S \ * 

- - k - r 

and 2) if n,k€N and a.,b € S such that a. E . b., then for each 
a, - € S there is some b. . € S such that a. E b. . and such that 

Mb^JNHCn.k^gX^dlbJh). 

THEN 

I) For all n,k€N and ^^fS , ^ E n b fc =» ^ = b fc . 
and II) S is H-bounded. 

Proof : 

Proof of JQ bji induction on n: I) certainly holds if n=0. Assume I) 

is true for n; we will prove it for n+1. 

Say that a, E b. ; we wish to show that a, = b . By Lemma 2.4 
and the symmetry of E . , it is sufficient . to show that for every a^ . - € S 
there is some b. € S such that a. - = bj-.-|« So choose a. . € S. By 2) 
there is some b. _ €s such that a^- E b. .. By the induction hypothesis, 



«s*p*S*>8ff^:^-' 
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*k+l n b k+l' 

- k 
Proof of III: Let FO^-i) be a formula of q-depth £n and let a^ € S 

be such that a>t k+1 F(a k ,x fc+1 ) is true. Lefca^es be such that FCa,^), 

holds. Since L E . a., condition 2) ippliwl that we can find aome 

a^ +1 6s such that ^ E n (a^a^) and *ueh that 

I U^ +1 I I ^(n^Max^ | U t \ |] ). But by 1), a^ E a C^.^) *»■ 

*k+l n ( *k» a k+l ) ** F< \» a k+1 ) h0ld8 ' ^ * l8 *l ,mmiled - D 

By applying Remark 2.9 to Lemma 2.12 we immediately obtain Lemma 2.12'. 

Lemma 2.12' ; Say that for each n,k€N we have an equivalence relation E n 

on S satisfying the following properties: 

1) For all k€N and all V\ € S k , \ % \ * \ 6 V 

and 2) If n,k€N and \,\ € S k such that l^ E n+1 b k , then for each 

a. € S there is some b fc+1 € S such that a^ ^ E n b^^* 

- - k- ~ "_r 
THEN for all n,k€N and a^b^S , \ E n \ * \ % k' 

We loosely define an "Ehrenf eucht game (abbreviated E-game) decision 
procedure" for TH(S) to be one that involves defining relations E n and 
proving that the conditions of Lemma 2.12 or 2.12' hold, this will be made 
clearer in the examples of Section 3 and Chapter 3. In Section 4 of this 
chapter we present a general discussion of the computational complexity 
of E-game decision procedures. 

Lemma 2.13 shows how H-boundedness implies bounds on the norms 
of members of the = equivalence classes. 

Lemma 2.13 : Let H^-^N be such that S is H-bounded. Let n,k€N and 
let m^^ be a sequence such that m ± ^H(n4k-i,i-l, Max^m^) ) for 
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l^i<k. Then for each a, € S there is some b, € S such that a^ = b^ 

and I lb. I I £m. for l^i^k. 
1 x i 

Proof : Let n,k,rrL , and a, be as in the statement of the lemma. By 
Lemma 2.6 there is a formula F(x, ) of q-depth n which defines the = 
equivalence class of a^. Since F(a k > holds, S^ 3x 2 - . . 3^ F ( x^) is true. 
So by Lemma 2.11, (3x <m ) (3x 2 <m 2 ). . . (3^ ^m^FC^) is true. This 
means that for some b €s , F(b.) is true and | jbj | tSnu for 1 £ i ^k. D 



^- : ^^p^fc^*b.^^ ft- 
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Sectlon 3: An E-Game Decision Procedure for Integer Addition 

We now present some applications of Section 2. For the rest of 
this section let i. be the language of the first order predicate calculus 
with the formal predicates * l + v 2 *v 3 and VjSv 2 and the constant 
symbol (where v,,v„,v 3 represent formal variable^). 

Definition 3.0 : Let Z be the structure < Z, +, £, > where Z is the set 
of integers and where + and £ are the usual integer addition and order. 
If a € Z, define ||a|| = |a| = absolute value of a. 

We will obtain a theoretically efficient decision procedure for TH(Z) 
using results of the previous section. Although we will be using an 
Ehrenfeucht game approach, many of the ideas we shall use come from a 
quantifier elimination decision procedure for TH(Z) obtained by Cooper 
[Coo72] and analyzed from a complexity viewpoint by Oppen [Gpp73], We 
choose this example because it illustrates our thesis that all known 
quantifier elimination procedures can be converted to E-game decision 
procedures without significant loss of time and sometimes with a saving 
of space. Some of our results about TH(Z) appeared in preliminary form 
in Ferrante and Rackoff [FR74]. 

Although our procedure for TH(Z) has about the same time complexity 
as Cooper's, it only requires a logarithm of the space used by Cooper's 
procedure. 

Definition 3.1 : If a, b, c 6 Z, then a » b mod c,<a i» equivalent to 
b mod c) if c divides a - b. If A is a nonempty finite set of integers, 
then lem A = the least positive integer which every non-zero element of 



A divides. 
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t 



Definition 3.2 : Let a, b € Z and let d € K . Then we write a 



* b 
d 



if either 1> a - b 

2) a^d and bid 

or 3) a s; -d and b £ -d. 

When we talk about ■ holding between objects one of which ia the 

d 
cardinality of a set, we will often omit the vertical lines indicating 

cardinality. For instance, if A and B are sets, we will write A « B 

d 

and A - 5 instead of |a| =» |b| and (a| • 5. 
d d d 

+ 
Lemma 3.3 : Let a, b € Z and let d € H . Then a « b «» ■ 

d 

for every c, -d < c £ d, a «* c *» b as c. 
Proof : Left to the reader. ^ 

Definition 3.4 : Define a sequence of sets of integers V Q , V^, Vj, V^, 

as follows: V- = {-2, -1, 0, 1, 21 . If V ± has been defined, define 

V' = f -• v ' I 6 - 1cm V ,; v, v' € V .; v 4 0\ and define 
i l v . i i 

V i+1 = V i U(a + b I a * b € V i } * 



Definition 3.5 : Let n, k € N. Then define the equivalence relation 

k — — k 

E on Z as follows: Let a^,, b fc € Z , let ft * lem V^. 

We use this nonstandard notation for equivalence mod c so as not to cause 
conflict with other notation we use. 
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k 



Then a^ E n b fc iff for every v fe € (V n > 



1) E v.a, m E v b mod 6' 
i-1 1 i 1=1 

k k 
and 2) £ v.a, = E v b 

1-1 l 1 .2 i»l X X 



Lemma 3.6 : Let k € N and let a^ b fe € Z such that a^ E Q b fc . 

Then a. = b, . 
K 

Proof ; Say that a, E Q b fc . We wish to show that for any quantifier 
free formula F(\), Z I- F^) * Z > F^). Since every quantifier 
free formula is a boolean combination of atomic formulas, it is 
sufficient to assume F is atomic. We need only consider the following 

cases for F: 

x x * x r x x * x 2 , x t + x t - x x , x x + x 2 = x v x x + x t = x 2 , x x + x 2 - x 3 . 

In these cases, in order to show that Z h F(a^) « Z h F(b" k ), it is 

necessary to show (respectively) that p<0»0« 0, 

a x - a 2 * « b x - b 2 * 0, a x - <=» ^ » 0, a 2 = » b 2 = 0, 

2a t - a 2 = « 2b x - b 2 = 0, a x + a 2 - ^ = « b,_ + b 2 - bg - 0. 

But since 0, 1, -1, 2, € V Q , all these facts follow from 2) in the 

□ 



definition of E Q . 



en 
2 



Lemma 3.7 : For some constant c, |vj * 2 and V n - {-a | a € V n ) 



9 cn 
o 
and Max V ^ 2 for all n € N. 
n 



^^^'^^^0.^ 
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Proof : |vj • 5. In general* \*j\ * j^f arid 

Iv 1+1 l * IvJ + |v-| 2 * |v i l 5 . So |vj s s 5 ". 

It is trivial t© show that V » {-a | a € V } . 

It u 

It I : 

Max V Q - 2v In general, Ion V ± * (Max V^ 1 i! *. So 
Max V . s Max (Max v t , 2.Max V*> * 2- lcm V^Max V ± 

£ 2- (Max V^ 5 • Max V £ (Max V^> & . Sto Max V Q < 2 

,cn J*- 

Iv I ^ 2 and Max V £ 2 for son* constant e and all n € B. □ 

1 n ■ n 



Theorem 3>8 : There exists a constant d such* that Che following &*- true: 
Let n, k € B and let a^, b" k € £ such that a^ B^j IjV Than for each 

a^. 6 Z there .exist* some h^ € Z such that a^ E & b^ and such that 



2 dCn+k) 



|b | * (1 + Max fb }).2 2 
fc+1 l*i*fe 1 



Proof: Say that a. B n+ . 1 \ a^ t*at ay^ € Z* let 6 - 1cm V n and 

2 ...... ..k .. . . , 

note that 6 - 1cm V* since 1 € V . Let T - f Ev.e, + v | v € V' 

B n i«i in 

for Mis k and |-v| « 6 } be a nonempty subset of Z» There must 
exist either a member of T which is * ^a^ or * tmabev of T a 6 « fe+ . 1 

(or both); these two cases are symmetrical, so assume without loss of 

generality that some member of T is < *%+i' Let ^ v i*i + v *»* tn * 

i»l 

largest member of T which is £ ^a. . where v. € V ' for 1 £ i * k and 
| v| sj . Consider the sequence 
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k k k k 3 

£ v,a, + v, £ v.a. + v + 1, £ v.a, + v + 2, . .. , £ v a + v + 6 . 
i=l H . i-1' 11 1-1 A i =1 

If 5a, .. Is not equal to any of them, then Sa^ is bigger than all 

of them and one of them (other than £ v a + v) is equivalent to 

1 =1 

8a, , mod 6 3 . It is therefore the case that for some u: |u| s 6, 
k+1 

k 3 k 

and £ v.a, + v + u w 6a. ,. mod 6, and £ v a + v S 

i=l i i * +1 i=l X X 

k ■ k 

£ v a ± + v '+ u * &\+i> and u = « £ v^ + v = &\ +1 * 
i=l i-l 

k 
Claim : For every t € T, t £ £ v.a + v + u » t < 6a. . and 

i=l x x 
k 
t s £ v.a. + v + u «» t ^ ^^hr+i* 
i=l 

•■ k 
Proof of Claim : If £ v a + v + u = ?>\ +1 > then the claim is trivial. 

i=l 
k k 

So assume £ v a + v + u 4 ^>\ +l - Then u ^ 0, and so £ v^ + v + u is 

1 i k k 

strictly between £ v^ + v and 6a fc+1 . Since ^v^ + v is the largest 

member of T £ 5a. ., we cannot have any t € T such that 

k 

£va + v + u a! t * 6 a. . ; hence the Claim follows. 

i=l i l ^ +1 

Now let y = 1cm V^. Since € V n , ■ € V^' .. Therefore V^ = V^. 

Since 6 2 = 1cm V and V .. = (2e|e € V M , we have 26* divides y. Since 
n n+i n 

k k 2 

a, E -b , £ v.a « £ v^b mod y , and so 6a fc+1 «* 

i=l i=l 
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k k 3 

E v . a . + v + u m E v . b . + v + u nod 8 
M 11 H 

k 
implying that 6 divides E v fr + v + u. Define 

i-1 X 

b k+1 = ( E v i b i + v + u)/6. We will show that ■| ri . 1 E | '\ fl » 

k+1 k+1 2 
let "t^i € 00 . We want to shim that E w,a 4 m Ew.b, mod 6 

k+1 k+1 

and that E w.a. - E w.b . If w.,, « 0, then these facts follow 

i-1 li t 2w 11 - fcfl 

o 

— — 2 

immediately from the fact that ejE-Ai !- » inc * v c V-^i e* 1 ^ 6 divides 

2 
Y . So assume w^, ^ ' 0". 

k k 2 

Since aJE .-b. , we have E w a. m E w v b, and & . Thus to show 
it n+l it litl l i tW j ll 

k+1 k+1 

that E w a. as E w.b. mod 6 , it is sufficient to show that 

i-1 L i-1 1 

w k+i*k+i ~ w k+i\+i "^ fi2 ' But ViVi " w k+i b k+i ■ od 62 

k+1 k+1 2 

«* fijL.. w 6 b. , mod (S/w.^^ ). Hence E w a. « Ew.b. mod 6 . 

k+1 k+1 

Next we will, show that E w^a. *„ . S w^b . Since V » {-a|e£ V ], 

i-1 8 Z i-1 x n 

k+1 k+1 k+1 k+1 

and since E w.a. «. £».>. ** E -w^a^. * E -w,b. , we can assume without 
i-1 1 L 6 Z i-1 x 1 i-1 z x 6 2 i-r X * 

loss of generality that w > 0. By Lemma 3.3 it is sufficient to show 

k+1 k+1 

that E w a £ d « E w b. for every d, jdf £ 6 . therefore fix d, 
i=l * i-1 

|d| * 6 2 . 

k+1 k 

E w^ * d - ( E (6/w fc+1 )w i a i ) + 6 V * d<«/^ > • 
i-1 i-1 

k 

6 



" k+1 * ( i f 1 ( " 6/Wk +l )W i a i ) + d (8/w k+l>' 
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( ' 6/w k+l )W i € V n for * * i * k and l^^fc+l^-^ 6 » so 

k 

( E ("S/Wic+i^i 8 !) + d(6/w k+l ) € T * By the abOV6 C]aim * we Can 

i=1 k 

continue: fia^ *(£ (- 6 / w k+1 ) w i a i )+ d(8/w k+l ) ° 

i=l 



E v^ + v + u a ( £(-6/w k+1 )w iai ) + d < 6/w k+l ) ** 
i=l i=l 

k 

E (v t + ( 6 / w k+1 > w i ) a i * d ( 6/w k+l ) " v " u « 



d(6/w k+1 ) - v - u | ^ 36 3 s y 2 (since 26 2 divides y). 



Because a,E + ,b we have 

^(v. ■+ (6/w k+1 )v i )a i * d(6/w k+1 ) 

k 

E (v ± + (fiA^Vbi. * d(5/w k+l ) ' V ' U ° 

k k 

E (S/w^w^ + E v b ± + v + u a d(6/ Wk+1 ) » 
i=l i=l 

k k+1 

± ^\ +1 )\\ + 6\ +1 * d(6/ Wk+1 ) « E i w i b i * d. 



It remains to calculate the size of b ^ . 

k 3 3 

lkij.il < I S V A + v + u| ^ k-MaxV .. -Max (b } + .6 + 6 
k+1 i=1 i I n-ri ^^ * 

=£ k'Max V ...-Max fb,} + 2. (Max V )' n 1 ' . Therefore by Lemma 3.7, 

2 d(n+k) 

we have for some constant d, | b. , _ | £ (1 + Max (b,})2 ■'■■■*■ □ 

™ l*i£k l 
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Corollary 3.9 ; For some constant d, Z is H -bounded where 

,d(rri4c) 
■ V"- ■ 
H(n,k,m) - (1 + m)2 

Proof : Immediate from Lemmas 2.12, 3.6 and Theorem 3.8. D 

Theorem 3.10 : Let F be the sentence of £. , Q 1 x.Q x....Q x G(x ) where 
————— iliz<£nnn 

G is quantifier free. Then for some constant d independent of n, F 

,dn+l 9 dn+2 9 dn+n 

2 2 2 — 

is equivalent in Z to (Q.x. < 2 )(Q Xo * 2 )... (Q x„ < 2 )G(x ), 

11 £■ i. n n n 



9 d(tt4fe) 

2 
Proof : Say that Z is H-bounded where H(n,k,m) » (1 + m)2 

,dn+i 

2 
Let m. - 2 for 1 £ i £ n. Applying Lemma 2.11 to Z, we see that 



since m, * H(n - i, i - 1, Max { |m |}) for 1 s i s n, F is equivalent 
1 l*j<i J 

to (Q^ S u^) (Q 2 x 2 < mp ... (0^ < *» n ) G (x n ) . 



Corollary 3.11 : For some constant c, TH(< Z, +, * t >) can be 
decided within space 2 . 



Proof : By Theorem 1.4.2, given a sentence F of £., convert it to an 
equivalent sentence Q-iX-tQoX? ••• Q„ x G 0* ) where G is quantifier free 



-41- 



and of length at most n log n where n = |f| . F is equivalent in Z to 

2 dn+l 2 dn+2 2 dn+n 

(Q lXl < 2 2 )(Q 2 x 2 < 2 2 ) ... (Q n x n < 2 2 ) G (* n > for 

some constant d (by Theorem 3.10). 

F can be decided in Z by setting aside for quantifier Q t , 1 £ i £ n, 

~dn+i 
~dn+i 2 2 

2 +2 tape squares; every integer s2 in absolute value 

can be written in this space in binary. Then decide F by cycling 

through each quantifier space appropriately, all the time testing 

the truth of G on different n- tuples of integers. We let "the reader 

convince himself that a Turing machine implementing this outlined 

2 CTl 
procedure need use only 2 tape squares for some constant c. □ 



Theorem 3.12 : For some constant c', any nondeterministic Turing 

2 c'n 
machine which recognises TH(Z, +, ^, 0) requires time 2 on 

some sentence of length n, for infinitely many n € N. 

See Fischer and Rabin [FiR74] for a proof of Theorem 3.12. Their 
proof uses the method described in Chapter 1, and hence, for the 
reasons described in Chapter 1, the upper bound of Corollary 3.11 matches 
the lower bound of Theorem 3.12 reasonably well. 

Definition : Let R be the structure <R, +, £, (P» where R is the set of 
real numbers and + and ^ are the usual real addition and order. 

As above, the upper bound for TH(F) in Theorem 3.13 is close to 
the lower bound of Theorem 3.14. 
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en '■■ 
Theorem 3.13 ; For some constant e* TH(R) cm be decided in space 2 . 

The proof appears in Ferraefce and Rackoff [FR74}. Although part of 
their proof uses quantifier elimination, it could be rewritten to follow 
the E-game format used above without loss of efficiency. 

Theorem 3.14 ; For some constant c f , any nondetermlnistic Turing machine 

— > n »■■■ 
which recognises TH{R) rosuires time 2 on some sentence of length n, 

for infinitely many n. 

See Fischer and Rabin .&&3A] for a proof of Theorem 3. 14. 
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Section 4: Complexity of E-Game Decisio n Procedures. 

We have mentioned that an E-game procedure for deciding TH(S) is 
one which proceeds by defining relations E n and proving that the 
conditions of Lemma 2.12 or 2. 12' hold. It is then necessary, in 
order to decide a sentence with n quantifiers, to he able to write 
down for every i between and n representations of all the E ± 
equivalence classes on ^ ; this is what is really going on in 
Lemma 2.11 and the examples of the previous section. Chapters 3 and 4 
contain further applications of these ideas. 

It is not enough only to be able to write down for every n, k € N 

representations of all the E equivalence olasie* on S , but this is 

certainly a necessary part of an E*game decision procedure. Recalling 

that the 1 classes are at least as numerous as the s classes (because 
n n 

of Lemma 2.12), we see that if an E-game procedure (as we have described 
them) is to be elementary recursive, it is necessary that M(n,k) be 
bounded above by an elementary recursive function. 

Now the only other method we know about for obtaining elementary 
recursive decision procedures is elimination of quantifiers, and we have 
stated above that in all known cases a quantifier elimination procedure 
can be transformed into an E-game procedure without sacrificing (if it was 
there in the first place) elementary recursiveness. What this means is 
that in order for a logical theory to be elementary recursively decidable 
by known methods, it is necessary for M(n,k) to be bounded above by an 
elementary recursive function. This raises the following important 
conjecture. 



-44- 

Con lecture 4.1 : If TH(S) has an elementary recursive decision 
procedure, then M(n,k) is bounded above by an elsiasntary recursive 
function. 

Although Conjecture 4.1 is open, its converse is definitely false. 

Counterexampls to t^e Converse of Con lecture 4>1: 

For the purpose of this cotmtar example, let X be the language of 
the first order predicate calculus with the formal predicates Vj^ - v.j 
and v. ~ v.* (v. is equivalent to v 2 ) and the tons tam* symbol 4 (although 
the constant symbol isn*t really necessary). 

For every no ne mpty set A of positive integers let -y be an 
equivalence relation on N such that for every positive integer i 

1) if i € A then there is exactly one -v equivalence class of slse i. 

A 

and 

2) if i. £ A then there are no equivalence classes of sise i. 

Define the structure S. ■ < N, «, ~, >. 

a A 

For any 1 € N , there is a sentence F. which can be obtained in 
time polynomial in i which says that there is an equivalence class Of 
sise exactly 1. Therefore, if TH(» A ) can be decided within time g(n), 
then A can be decided within time g(P(h)) + p(n) for some polynomial P. 
Since we can make A arbitrarily hard to decide or arbitrarily nenreeursive, 
we can make TH(S.) arbitrarily hard to decide or arbitrarily nonrecursive. 

Now let A be a fixed set of positive integers and consider M(n,k) 
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for S. : we will show that (no matter what A is) M(n,k) is bounded above 
A 

by an elementary recursive function, contradicting the converse of 
Conjecture 4.1. 

For each a., b" k 6 N k define s^ E n b" k iff for all i,j such that 

1 £i,j ^ k, 

I) a. ~ « b ->■ 0, and a ± = « b^ = 0. 



II) a. ~ a. « b. ~ bj , and a. = 3j « b t = b r 

and 

III) (a € N | a ^ a,} = {b € N | b -y b } . It is not difficult to prove 
• * n4k X 

Lemma 4.2 using Lemma 2.12'. 

lemma 4.2: \ E^ \ =* ^ J \. 

Since the number of E equivalence classes on N 

n 

is bounded above by an elementary recursive function (of n and k) , 

„c(n4k) 
namely 2 , M(n,k) for S. is bounded above by the same function. 
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Chanter 3; Weak Direct Powers 

Section 1: Weak Direct Powers and Ehrenf eucht Games 

Let X be a language of the first order predicate calculus with a 
finite number of predicate symbols ft., ft_, •••,§.* such that ft. tea t. 

place formal predicate for 1 < is 1, and with a constant symbol s. 

Definition 1.1; Let S « < S, ftp »£,..., ft^, e > be a structure for £. 

For all a € S, | I a| | is the norm of a. The weak direct power of 3 
is the structure S « < S , ft-, ft,,..., &*, « > where 

S* - {f: N ■♦ S | f(i) f« e for only finitely many 1 € N}; 



for 1 * 



J s i, If 1 € (S*) j » then 1 € &* iff 1 (i) € ft. for all 

J J J J 2 



i € N (where f\ (1) abbreviates (f.(i), f <i),..., f (i)) ); 
e*(i) - e for all i € N. 

■k * 

For a norm on 8 we define, for f € S , 
| |f 1 1 = Max({i € H 1 f(i) 4 e} U { 1 1 f (i) 1 1 1 1 € N}) . By f < m we will 
mean 1 1 f 1 1 £ m. 

Mostowskl [Mos52] and Feferman and V aught [FV59J both show that 

it 

TH(S) decidable =» TH{* ) decidable. However, their proofs are such that 
in every case, the decision procedure for TH(& ) obtained is not elementary 
recursive. In tills section we will present some general theorems which 
will allow us to derive significantly more efficient decision procedures for 
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TH(S ) in many cases, and in particular to obtain a procedure for TH(Z ) 
(where Z is the structure of integer addition defined in Chapter 2) 
which closely matches the known lower bound. In Chapter 4 we prove 
even more general theorems which give a condition under which we can 
conclude TH(S*) elementary recursive if TH<») is elementary recursive. 
Now let H: N 3 -♦ N be such that » is Abounded. Let M(n,k) be the 
function as defined for 8 in Chapter 2, definition 2.2.5. 

Definition 1.2 : Define the function \i: N -» N by setting n(0,k) = 1 

n 
and n(n + 1, k) = M(n, k + lW(n, k + 1). Hence n(n,k) - H M(n - i, k + i), 

* _3 * 
Definition 1.3 : Define H : IT -♦ N by H (n,k,m) » 

Max {H(n,k,m),m + |i(n + 1, k), ||e||}. 



The major theorem of this section will show that & is H -bounded. 

We now prove a combinatorial lemma. ■ is defined in Definition 2.3.2. 



Lemma 1.4 : Let N. and N 2 be sets and let n, m € N such that 

H, - N„. Let A., A ,..., A be a sequence of (possibly empty) pairwise 
1 n»m i. .1 *• n 

n 
disjoint subsets of N. such that UA. «»,. 

1 i=l 

Then there exists a sequence B^ B 2 ,..., B n of pairwise disjoint 

n 
subsets of N, such that U B ± .» N 2 and such that k ± jB^for Ui^n. 

i™l 
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Proof : If |n.| ■ |n 2 I then the Lemma is obvious. Assume |n.jJ * n»m 

and |n 2 I ^ n«m. For some i, 1 ^ i * n, we must have UJ a m, so assume 
without loss of generality that |a. | ^ m. 

Define numbers p 2 , p_,..., p ft € N by 



C |A i J if UJ < m 
V m if |a ± | * m 



for 2 £ i £ n. 



Clearly j p. s (n • l)m «n*m- m. Since |nJ a n»m, there exists a 
i=2 i 

sequence of pairwise disjoint subsets of N 2 , namely B 2 , B^,..., B n , 

such that |b. I = p. for 2 s i ^ n. So A. » B. for 2 £ i &a. %»t 
'11 l m x 

n n 

B, * N» - U B.. |n 9 | * n«m and LIB. s n«m - m, so |B-| * m. Since 
1 l i=2 i ■ ■ 1=2 1 X 

|A X | *m, A lS B r D 



For every n, k € N, define the Ehrenfeucht relation = on both 
S k and (S*) k as in Chapter 2, Definition 2.2.1. 



Definition 1.5 : Let n, k € N and ? k> g fe €(S ) . Then we Bay l fc E n g fc 

iff for all 1 € S k , {i € N | \(i) = \) = (i € N | g^Ci) = a^) . 

H(n,k) 



Lemma 1.6 : For all k € N, f fc , g fc € (S*) , if f fc E Q g^ then f fc g g fc . 
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Proof : Say that f, E Q g.. We wish to show that for every quantifier 

free formula FO^), »* H FOf^) » S h F ^ k >- I* is clearly sufficient 

to prove this for the case where F is atomic. By symmetry, it is 
sufficient to show that F(f fc ) false in 8 =» F^) false in S . 

Thus assume that F(f.) is false in S . By definition of the 

relations of S we can choose i Q € N such that F(f k (i Q )) is false in S. 

Since f k E Q g k , we have that {i € N | f^i) = f k (i Q )) - 

{i £ N | g^i) = £ k (i )}. Since u(0, k) - 1, we have 

|{i € N | 8^(1) = f k (i )} 1*1- So let i x € N be such that 

g^Cip §-\(i )* By deflnit4OT of o» F( \ (i )) fal8e ln 

8 =» F(g k (i x )) false in 8. So FCg^) is false in * . □ 



Lemma 1.7 : Let n, k € N and "f^, g^ € (S*) k such that ^ E^ g fc . Then 

* * 

for each f fc+1 € S there exists some g^ € S such that 



and 

2) llgfc.,11 *H*(n,k, Max (llg.ll}), 
*"■ lsi^k x 
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Proof : Let f^, g^ € (S*) k be such that f fc E^ g fc . Let 

= Max {||g 1 l|} and let f^ € S . Let b^, b^,.-., b fcfl 



m 

l^i^k 



be a sequence of representatives of all the ■ equivalence classes om 
S* 41 . Our goal is to find g^ 6 S* such that If 1 £ j * M(n, k*l), then 

(i € N If^i) ■ ^i) ^^t* 6 N I W*> n *h) ; ~ al ~ *"* 

| | g | | £ H*(n,k,m). Instead of defining g fc+1 simultanooualy on all of N, 

we will define it separately on various pieces of H. 

For each \ € S k define N 1 (a fc ) - (i € ■ j \(t) * ^j and 

N (Z ) - {i 6 N | 1.(1) = a.}. We elder it is sufficient to define 

n+1 

g fc+l on each N 2^ a k^ 8llch tbat 

i) {i e VV | f^d) ; t^^ < 4 € N 2<V I %*!<» 5 ^ 

for all j, 1 ^ j * M(n,k+1). 

II) If i 6 N^a^) and i > m + p.(n + l,k), then g^U) * *• 
and 

III) If i € NjUfc) and i ^ m + n(n + l,k), then I 1 8^(1)1 1 * H(n,k,m). 



# it 

An examination of the definitions of H and the norm on S will show 



V^^^itrt-v--: 
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that II) and III) together imply | Igj^l | * H (n,k,m). Since 
{N 1 (a fc ) | a^ 6 S*} and {N 2 (a^l a^ € S } are each a collection of 



disjoint seta, it is easy to see from I) and the definition of 

that if 1 ^ j * M(n,k+1) then 
Ii(n,k+1) 

(_U k Ci CN^a,) | ^(t) =^}) - < U. Ci ^N^li^Ci) f b k+l))i 

a-€S (i(n,W-l) a^tS 

i.e., (i € N | f^i) - bj^} - Ci € H I ^(i) - b^} . 

|i(n,k+l) 

So now let a. € S k he fixed for the rest of this proof. Abbreviate 

R 1 ( V ** *1 ^ VV ^ V Be « 1,a by defi»i»t ^fc+^i) " • i f 

I € N„ and i > m + |x(n+l, k) ; this guarantees II) above. It remains to de- 

fine ^ro N 3 « {i € N 2 | i £ m + n(n + 1, k)) . 

The definition of E .. implies that N. - N-. We nov 

11+1 V(xH-l,k) Z 

demonstrate that N. = N,: if I s e k then N, is an infinite set, 

V(i«+l,k) n+i 

and |N 3 | * n(n + l,k) since g^i) > e k f or m < i * m + |i(n .+ l,k); if 

I ? e k then V 3 - N 2 (since i > m + jx(n + 1, k) *» 8^(1) » e k => i t N 2 ). 
n+1 



So N- - ■ ■'■ N 3 . 
1 n(n+l,k) p 

Define, f or 1 * j S M(n,k+1), Aj • (i € K x 1 \,. x <i) = ^+1^ • 
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A_, A„,..., Aj,. .-.J-V- form a sequence of palnd.se disjoint sets whose 

union. Us.*.. ' Since m, * N_ and nfia. + l,k) - M(n,k 4- l>'|i(n„ fc + 1)* 

1 * u(n+l,k) 

Lemma 1.4 tells *s there exists a sequence B^ B 2 ,..., Bjj/- j^™ of 

pairwise disjoint subsets of N* whose union is N, such that 

A. - B if 1 ^ j * M(n,k+ 1). 
J n(n,k+l) 3 

Now let i € »-; we want to define « fc+1 on i. Let j he such that 

i € B.. Since B. 4 0, we also have A. 4 0. So let i Q € A.. Since 

i Q € N x and i € » 2 , we t»eve \(i Q 3 s \ * A^U)- By Lemma 2.2,10 

n+1 n+1 

we can define ■« fcfl <i) »«<* that f fcfl < i ) = Sfc+i* 1 ) and 

| |g fcfl (D I I * H(n,k,Max{ | Ig^i) | | , | |g 2 (i) | | ,..., | Ig^i) | I}) * H(n,*,m). 

Clearly III) above holds. Since i Q € A., ^jUg) n Krfl* ^° 

i & 

g (i) = b^ .. Thus, we have defined g^. € S so that for 

1 * j £ M(n,k+1), 

C* € N 3 I W*> I *£«> ' B j ^ M1) A j * <* 6 N l I W« 5 ^ 

To complete the proof of Lemma 1.7, we must show 1), i.e., 

{i € N ? | £.-(!) = bj,.} = A when 1 * j * M(n, k + 1). 

Z -fcfl n k+1 Jl(BfW . 1) J 
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So fix j, 1 * j £ M(n, k + 1). If 

(i <E N 2 | I k+1 (i) = bj. +1 } « {i € N 3 | g^d) ■ ^ +1 ) *« «« done, so assume 

{i € N 2 | I k+1 (i) I bJ +l) * (1 € N 3 | I w (i) ■ b^ +1 ). Since 

N» = {i € N 2 | i * m + n(n + 1, k)} , there must exist some i > m + n(n + 1, k) 

such that i 6 N 2 (hence g k (i) ■ a^) and g fc+1 (i) ■ b fc+1 . But since 

n+1 

i>m + u(n + l f k) implies 1^(1) - e** 1 , this means that a^ n = x e 

and bj ffl = e** 1 . Hence, both Aj and (i ^ N 2 | S^C 1 ) s t>jUl } are 

infinite, so (i € N ? | 8^,(1) **l +l ) V ° 

2 k+1 n k+1 ^(n^+D J 



Theorem 1.8 : * is H -bounded. Also, for every n, k 6 N and 
\, ^ € <S*)\ \ \ \ - \ I v 



Proof: This follows immediately from Lemmas 2.2.12, 1.6, and 1.7. D 
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Section 2: Applications 

We now present some applications of the material in Section 1. 
Let £- be the language of Chapter 2. 

Let Z = < Z, +, £, > be "the structure of Chapter 2 and let 

Z = < Z , 4^5. J° ^ As before, for 

a € Z let | |a| | = |a| and, following Befinition 1,1, for f € Z let 

||f|| = Max ({i € N | f(i) 4 0] U {|f(i)| |i €»}). 

9 e(n+k) 
Lemma 2.1 : There exists a constant e such that Z is (l+m)*2 -bounded. 

od(n+k) 

2 
Proof : By Corollary 2.3.9, Z is H-bounded where H(n,k,m) = (1 + m)«2 



for some constant d. We now calculate bounds for the function M(n,k) for Z. 
2 d(n44c)+i 

i 



2 

Letting m. = 2 for 1 £ i £ k, we see "that 



m * H(n + k - i, i - 1, Max { fm | } ) for 1 £ i-«.k. So by Lemma 2.3.13, 

lij^i J 

— k — k - — • — 

for each a. € Z there is some b. € Z such that }Sl^ *= b. and 

|b J £ m. for 1 ^ i £ k. Hence, since m. £ m. , we certainly have 

-d(n4k)-Hc -d'(n4k) 

2 k n 2 

M(n,k) £ (2*2* + 1) K . So fi(n,k) - II M(n - i, k +1) <■ 2 

i=l 
for some constant d 1 . 

* 
So for some constant e, H (n,k,m) ■« MaxfH(n,k,m) , m + n(h + 1, k), 01 ^ 

2 e(n+k) 

(1 +m)-2 2 . . 
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,e- (n+k) 

* 2 

By Theorem 1.8, Z is (1 + m)*2 -bounded. □ 



Theorem 2.2 : Let F be the sentence of £, , Q,x.Q_x ... Q x G(x ) where G 
— — — — — — lllzznnn 

is quantifier free. Then for some constant e independent of n, F is 

2 eiri-l 2 en+2 2 en+n 

equivalent in Z* to (Q^ < 2 2 )(Q 2 x 2 < 2 2 ) ... (\\< 2 2 )G(x n ), 



Proof : Theorem 2.2 follows from Lemma 2.1 exactly as Theorem 2.3.10 
follows from Corollary 2.3.9. □ 



* 
Corollary 2.3 : For some constant c, TH(< Z, +, £, > ) can be decided 

cn. 

2 
within space 2 



Proof : By Theorem 1.4.2 it is sufficient to consider the sentence F of 

X. which in prenex normal form is Qi^Q^o "* ^n x n G ^ X n^ ^ ere G is 
quantifier free and of length at most n log n. 

By Theorem 2.2, F is equivalent to 

2 en+l 2 en+2 2 en+n 

(C^x < 2 2 XQ^ < 2 2 ) . . . (Q n x n < 2 2 )G(x n ) for some 



constant e. ^ -en+i 

Now if f € Z* and f < 2 2 , then f(j) = for j > 2 2 and 

2 en+i 2 en+i 

|f(j)| £ 2 for all j € N, so the first 2 successive values 
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2 «+l 2 2 en+1 
of f can be represented on a tape with roughly (2 + 2)«2 

tape squares. So a procedure like the one outlined in Corollary 2.3.11 

9 cn . 

•*■■■' 2 

would decide TH(Z > In space 2 for some constant c. Q 



Definition 2.4 : Let N be the structure*: N » +,.s£, >, l.e, the 
weak direct power of the noxmegative integers (under + and *). 



* - ^ ■■■•■■' ■■■ 

Remark 2.5 : The structure < N , + > is isomorphic to the structure 

< N + , * > (i.e., the positive integers under multiplication). So an 

it + 

upper bound on the complexity of TH(N ) is an upper bound on TH( < N , * >). 

9 cn 

* 2 

Corollary 2.6 : TH(N ) can be decided in space 2 for some constant c. 



Proof : Since x 2 U a formula of £., it is easy to see 



that 



TH(N ) £ „ TH(Z ). So Corollary 2.6 follows from Lemma 1.3.2. D 
pi 



The upper bound of Corollary *2. 3 and Corollary 2.6 
matches the lower bound of Theorem 2.7 reasonably well. 

Theorem 2.7 : (Fischer and Rabin [F1R74],) For some constant c* > 0, any 
nondeterministic Turing machine which recognises TH(Z ) (or TH(N )) 
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2 c*n 



2 
requires time 2 on some sentence of length n, for infinitely many n. 



Our next goal is to present a decision procedure for the first order 

+ 
theory of finite abelian groups; this theory was originally shown to be 

decidable (see [Szm55], [ELTT65])by a less efficient procedure than ours. 

Our approach will be to show that this theory is £ & TH(N ) and conclude 

Theorem 2.8 : The first order theory of finite abelian groups can be 

2 cn 

2 
decided within space 2 for some constant c. 

There is still a significant gap between the upper bound of Theorem 
2.8 and the known lower bound of Theorem 2.9. 

Theorem 2.9 (Fischer and Rabin [F1R74]): For some constant c' > 0, 

any nondeterministic Turing machine which recognises the theory of 

2 c ' n 
finite abelian groups requires time 2 on some sentence of length n, 

for infinitely many n. 

The language of groups, JL, merely contains the formal predicate 
v + v- = v*. We are interested in deciding which sentences of £ 2 arc 
true of every finite abelian group. Recall that every finite abelian 



This topic is also discussed in Chapter 4 from a slightly different 
viewpoint. 
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group (henceforth abteevlated FAG) is Isomorphic to a finite direct 
product of finite cyclic groups [MB68]. For i a positive integer, 
let 2. denote the cyclic group (0, 1, ...» 1 - 1} where addition is 

performed nod i. The basic Idea of the embedding (due to Michael J. 
Fischer {Fis73 ] ) is to think of every noneero f € H as representing 
an FAG, G-. This is made precise in the following definition. 

Definition 2.10 : let f g N*. f 4 0*. Define Aj - |{i € N | f(i) 4 0} |. 
Define m f : {1,2,..., i f ) -» N by 

m f (j) - the $ th smallest member of {i € K | f(l) 4 0} for 1 s j s i f , 

Define the FAG G f » G^G^ ... XG^ where G » Z f . .... for l«js i f . 

* * 
Clearly every FAG is isomorphic to G f for some f € N , f 4 . 



Definition 2.11: Let f , g € N , f 4 , be such that for all 1 € N 



a) f(i) - -0 =» g(i) - 
and 

b) f(i) > *» * g(i) < f(i). 

Then we say that g rejgrjssents < g(m f (l)>, g<m»(2))» ...-, g(m f (A f )) > € G f . 

* 1 

Clearly for each f 4 , every member of G f is represented by a unique g € N 



We now describe some properties definable in J.- by formulas 

* 
interpreted over N . 
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1) ONE(x). For f € N*. ONE(f) will hold iff for some 

i € N, f(i) - 1 and for every j 4 i, f(j) * 0. ONE(x) is equivalent to 
x 4 0*A Vx'((0*^ x' A x' *x) -» (x' - 0*V x« = x)). 

2) ZERO(x 1 ,x 2 ). For f lf f 2 6 N? ZEROCfpfp will hold iff 
ONE(f-) and f^i) - =* f 2 (i) -. 0. ZEROCx^x^ is equivalent to 
ONECXj) A Vx'CCONECx') A x 1 4 x^ -» ~(x' £ x 2 >). 

3) PICK(x lf x 2 ,x 3 ). For fpf^ € N*, PICKC^.f^) will hold 
iff 0NE(F 1 ) and 

(f t (i) - =» f 2 (i) - 0)A<f 1 (i) - 1 * f 2 (i) m f 3 (i» . 
PIGKCx-^XjtXo) is equivalent to 

ZEROCXj^.Xj) A x 2 ^ x 3 A ^Xj + x 2 £ Xg). 

4) MEM(x x ,x 2 ). For fj^,^ € N , MEMC^,^) will hold iff f^ 4 0* 
and f ? represents a member of G f . MEM(x.,x 2 ) is equivalent to 
x x 4 0*A x 2 ^ x x A VxYxj,Vx 2 <[PICK(x f xJ,x x ) A PICK(x,x 2 ,x 2 ) ] -> 

(x« * 0*->x 2 * x')). 

5) PLUS(x r x 2 ,x 3 ,x 4 ). For f^fg.fg,^ € N*, PLUSCf^,^,^) will 
hold iff f. 4 and f_,f 3 ,f, represent members of G,_ and the member 
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represented by f, is the sum in G_ of the Mriwrt represented by f. 

and f g . PLUS(x-,x 2 ,x 3 ,x,) is equivalent to 

MEM(x 1 ,x 2 ) A MEM(Xj,x 3 ) A MQKx^s^) A VxVx'V x »Vx^Vx^ [ 

(PICK(x,x^, Xl ) A PICKCx.x^Xj) A PTCKCx.x^Xj) A PICK(x,x£,x 4 )) -» 

(xJ + x^xJVxJ + xj.x'+xJ)], 

Proof of Theorem 2.8 : Using formulae defining tSSM and PLUS and the fact that 

* # 

f 6 N represents a FAS if and only if f # , we obtain a procedure which 
operates in polynomial time and linear space which takes a sentence F of 
JC, to a sentence F' of £. , such that F is tma of every 

FAG » F' € TH(N*). So TH(FAG) * . TH(N*). Theorem 2,8 therefore follows 

from Corollary 2.6 and Lemma 1.3.2. D 
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Chapter 4: Some General Results about the Complexity of Direct Products 

Section 1; Introduction . 

Let £, S, and S be defined as in Chapters 2 and 3, and let M(n,k) 
be defined for S as in Definition 1.2.5. 

Theorem 1.1 : If TH(S) la elementary recursive and if M(h,k) is bounded 

* ■ 
above by an elementary recursive function, then TH(S ) is elementary 

recursive. 

Theorem 1.1 can be proven by modifying either Mostowski'e or Feferman and 
Vaught's decision procedure for TH(8), [tfes52*FV59]« but we present a 
different approach in Section 2 and prove there a quantitative version 
of Theorem 1.1. In Section 3 we present some similar results for other 
notions of direct products (besides weak direct powers). 

The converse to Theorem 1.1 is false. 

Counterexample to the Converse to Theorem 1.1 : 

Let £ be the language used in the counterexample to Conjecture 2.4.1. 
For every nonempty set A £ N define S as in Chapter 2 to be 

< N, =, -r, >. As in Chapter 2, by varying A we can make S A arbitrarily 

hard to decide. Let A be a fixed set such that 1 g A, i.e., there are no 
~ equivalence classes of size 1. 



Claim: S. consists of an infinite collection of infinite equivalence classes. 

1 A 
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Proof of Claim ; Since is not in an equivalence class of sise 1, there 

exists some number, say 1, such that 1 yO. Since k f 0, there exists 

some finite r class, and hence at least two 7 classes. So there 
A a 

exists some number, say 2, such that it is not true that 2 £ 0. 

Thinking of every member of N as an infinite sequence of members 
of N, we see that the strings 0,0,0,... ; 2,0,0,... ; 2,2,0,0... ; ... 
form an infinite set of pairwise inequivalent members of N . So * A has 

an infinite number of equivalence classes. 

* 
Let y.0,0,... be any member of H , where y is a finite sequence of 

members of N. The strings y, 1,0,0,. .. ; y,1,1,0*0,... ; ... form an 

infinite set of elements equivalent to y»0»0,... . So each equivalence 

class of S is infinite, proving the claim, □ 

From the above claimj it is not hard to see that a sentence of £ 

* 
with n quantifiers will be true in S. iff it is true in a domain of 

2 
size n consisting of exactly n equivalence classes of sise n. Therefore, 

TH(S ) can be decided in polynomial space, even though TH(S A ) may be 
arbitrarily difficult to decide. 



and Lemma 2.4.2. 



f * S'.y-JH* < ; # • ? ., ,«. fc - ?3^j8fc.-.fc«r$r,riW " a - iV* j 
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Section 2: Complexity of Weak Direct Powers . 

Our goal in this chapter is to prove Theorem 1.1; actually, we 
shall prove a quantitative version of Theorem 1.1, which relates the 
complexity of TH(S ) to the complexity of TH(S) and M(n,k). 

To begin with, let S = < S, &,,..., ft,, e > be a structure as before 

and let £ be the corresponding first order language. 5 and £ are fixed 

_ k 

for the rest of this chapter. Let = be defined on S for each n, k € N 

n 

as in Chapter 2, Definition 2.2.1. Let C . be the set of equivalence 

k i i 

classes determined by = on S and let M(n,k) = |C ,| as before. For 

a, € S , let [a, ] be the equivalence class of a^ determined by 3 . 

— k — 

By Lemma 2.2.6, for every a. € S there is a formula F(x.) defining 

[a. ] . What we are now interested in is how much time is needed, as a 
function of n and k, to write down all such formulas. 



Remark : Here is the motivation behind what we will be doing. Using a 
decision procedure for TH($) we will obtain (efficient) representations 

of the members of C , . This will allow us to use results of Chapter 3 

* k 
to obtain efficient representations of the s classes on (S > . We will 

then decide the truth of sentences in § by limiting quantifiers to 

range over appropriate serts of these representations. 



Definition 2,1 : We will define for every n, k € S a cdllection of 
formulas, 3- , such that in every member of ? . exaotly x-,x 2 , . .. , x^ 

occur freely. Firstly, for every k €K define 
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6 = {F(x. ) [ F is am atomic formula} ; for every W £ 6 

define F rt . «(*•,) «• *» <** formula (Af)A{ A H*); define 
°> K » W * F6W F€5.-W 

V " < F o,k,w I * h & i s,t 2 - *k F o.k,w(V)- 



Assuming fr , ., tecs been defined such the* in every member exactly 
n,wri 

x-.x^.*., x fcfl occur freely, we now define ^j k - For every W <= ? n ^ 
d * ftae F n+l,k,W<V * * ** f0rB " la ( £ ^W A ^ V *S*X F) ' 

Define 5^ . (F^^^) }*;► S*^ .... aVn+l.k^ . Clearly 
exactly x,,x 2 ,..., x. occur freely in each member of ^ tet , l k - 



Lemma 2.2 ; Let n,k € ». Then 

k i 
f A £ S some member of ? . defines A} ■ C .. Furthermore, every 

n ,k n,K 

member of C , is defined by a unique member of .3? .. 
n,K n,R 

Proof : Leuna 2.2 follows immediately from the proof of Lemma 2.2.6. D 

We next wish to calculate how long it takes as a function of n and k 

for a Turing machine to write down the set 3- . on its tape when 

n,K 

implementing Definition 2.1. In order for a Turing machine to do this 
at all it is necessary that TH(&) be decldabla, so for the rest of this 
section assume that there is some decision procedure for TH(&) which 

■■nw urn ■■■■■ii. in. >iiiini.ii mini ■ ■miiiHi iiniiiin.i— » iu*M,\m>**tmA*Mti*mm>m,*miwmtm*m~^\iWk»mimm —m^mmmtom m «n ■wn nu ■ mi i 

+ 

Every F € 7 . is considered to implicitly contain the annotation 

x p *2* ' " * * x k" 
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operates within time Tj(n). In order to simplify the calculations 
to follow, instead of working with the function Tj(n) we will use instead some non- 
decreasing function T x (n) 2 Max (Tj(n), 2 n }. It will similarly 

make things simpler below if we define the function 

T 2 (n) = Max({M(n - k, k) | * k * n} U {n}). + The reader may 

note that at many places in the calculations below we make gross over- 
estimates. This is because we are ultimately interested in the amount 
of nesting of exponentials in the complexity of our decision 
procedures, and our over-estimates do not affect this, whereas they do 
have the advantage of shortening the expressions we obtain. 

We first define L(n,k) to be the length of the longest formula of 

the form F , ... 
n,k,w 

To calculate L(Q,k), note that (a» in the proof of Lemma 2.2.6) 

|® | - £ (k + 1) * (where ft. is a t -place relation for 1 £ i £ &). 
k i=l 

As k increases, the length of the longest member of ©^ will increase since 

longer subscripts of formal variables will have to be written; however, 

for every k ^ the length of the longest member of 6 fc will be £ c^ (k+1) for 

some constant c- independent of k. Everything of the form Sq k>w looks 

like a concatenation of the members of S^, with some additional logieal 

symbols, and is of length £ twice the length of the ^concatenation of the 

members of S.. That is, 



*It is easy to see that T„ is nondecreasing. 
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'■■'■■& t C 9 

L(0,k)<;2«c-«(k+l)f«2D (k + 1) ■*■■' * (k + 2) * for sum constant c. Independent 
1 i»l 

of k. 

Everything of the form F . . . „ looks like a concatenation of the 

members of 7 .., , with some additional symbols; for some constant c_ 
n,Kri •■ -J' 

they are each of length £ c**(k + l)«the length of the concatenation 

of the members of ? -. , . That is, 

n» ktl 

L(n + . 1, k) * c 3 -(k + 1)-L(n, k + D'l^^J * 

c 3 «(k + l).L(n, k + l).T 2 (n + k + 1). Since 

L(0,k) = (k + 2) *■ and T 2 (n + k) * n + k we can calculate that 

c 4 (n+l) 
L(n,k)^(Max{T 2 (a4k>,2}) for every «*&.€ N and for some constant c 4 . 

Now define T(n,k) to be the time which a Turing machine implementing 

Definition 2.1 takes to write down 7 . on its tape. We first calculate 

n t K 

an upper bound on T(n + 1, k) in terms of T(n, k + 1). 

To compute 3* < k we begin by computing £ ..- within time T(n,k+1). 

We next write down beside £ -._ on the tape the set (F ... - „ | W c 5 vj*}. 

n^KTi nri,it t w n^KTi 

Then for each W '■■£ 3_ .., we write down the sentence 

ax.2x 2 ... 3x. F_.- . „, and then use our dec ia ion procedure for 

TH(S) to decide for each HC^ ^ if » H Sfa^Sfatj . . . Sx^ I x fc w » 

We lastly consolidate all the material on the tape (i.e. erasing F ... . tf for 
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cases where it is not true that § h 3x.3x 2 ... 3x, F ... , „) so 

that next to ? , ., we have written ^ ., , . 
n,k+l n+l,k 

For each W c & , we know that x-.x-, ..., x. occur in 

F n + l,k,W SO that l 3x l 3x 2 '•• 3x k F n + l,k,wl * ^JVl.k.W 1 * 3 ' L(n + X » k > ' 
The decision procedure for TH(S) decides whether or not 

§ H 3 X] 3x 2 ... 3^ F n+1 k w within time and space T^S'Un+l.k)) ; 

actually in order to decide if 3Xj3x 2 ... 3x, F + . . € TH(S) and 

return the Turing machine head (which started on the leftmost 3) to 

its original position requires time £ 2T (3-L(n + 1, k)). So when 

computing y + . . , the total amount of time used in deciding membership 

l\ k+1 i T 2 (n4k+l) 

in TH(S) is £ 2T ] (3'L(n + 1, k))«2 »»*"• s 2^(3 «L(n + 1, k))«2 

We lastly calculate how much time is used in computing ?_ , , . 

which is not used in either computing ■■ S£' . . or in deciding membership 

in TH(S). The total amount of space used in this way is the space on 

which ? , . is written plus the space to write F^,, ... „ for every 

W £ ? , + . plus the space to write 3x.3x- ... 3x. F +1 , „ for every 

i i ''n k+l' 

W = * M l this is £ (L(n, k + X >>* l^n.k+l' + (I(n + *' k)) ' 2 + 

'Vk+1 1 ^nk+1 1 T (n+k+1) 

(3-L(n + 1, k))-2 n ' K l * 2 n ' KTi -5-L(n + 1, k) £ 5-2 * -L(n + 1, k) , 



The time our Turing machine uses (aside from computing S* .,,. 

n,K+i 

or membership In TH(S)) Is spent in having the head go back and 

forth in this space doing the necessary amount of copying; the reader 

X*(n+k+l> c» _ 

can verify for himself that this is £ (5*2 -E(n + 1, k)) E 

t 
some constant c-. 

So the total amount of;, time used in computing 3L^ . 

T 9 (n4k+1) T-(nrtfcfl) c. 
= T(n + 1, k) s: T(n, k + 1) + 2T t (3-L(n + 1, 1#}rZ ' + (5*2^ »L(n+l,k)) * 

Since T 2 (n) * n an§. T»(n>) * 2 B for all n € », ws> can calculate the* 



for some constant c,, 

T(n + I, k> £ T(n^ k + 1> + [T^T^ + k +2 » " ) .] w . 



c g (n4k+l) c, 



It can also be seen that the time needed to write down 6. is 
polynomial in the space needed, and therefore £ (L(0, k>>) fo* some 

constant c_. Obtalnlatg 3L . from S fc is certainly quicker than obtaining; 

c- c fi (k+l) c, 

? lk from y . ffcfl , so we have T(0,k) * (LCQ,k» + [T^-C^Ck +2 )) ° )] °. 

Doing some final calculations we can conclude that 



t 
We are using the fact that we can simultaneously use space for two 

different purposes. For instance, some of the space on which sentences 

are written down is also used loir deciding truth of sentences 1ft &« 



-69- 
T(n, k) ^ [TjCCT^Cn + k + 2 )) c < n+k+1 >) ] c for some constant c and all 
n,k 6 N. 

Lenma 2.3 : For some constant c, there is a procedure which given n, 

writes down the sequence ?_ , !?.. .,..., 5 rt within time 

u,n i,n-i n,u 

[T^C^Cn +2 )) c(n+1 ^] c ; the length of this sequence is £ (T 2 (n +2 )) c(n+1) . 



Proof : When we were calculating above the time to write down £ _. we 
n »0 

were calculating as well the time to write down the sequence 







., ?, . , ? n . The length of the sequence is 

,n l,n-l n,U 



£ (n + l)(T 2 (n))-L(n,0) £ (T 2 (n +2)) c(n+1) for some constant c. D 



Remark 2.4 : Note that every member of ? n must be a true sentence and 
hence define the set whose sole member is the empty set. Therefore, 

Lemma 2.2 implies that M(n,0) = |? J = 1. 



Definition 2.5 : For every n, k € N, let F , be that member of? , 

J n,k n,k 

k 
which defines [e ] . That is, F , is the unique member of ? . such 

n ' n,k ^ n,k 

that 8I-F n v (e k ) (where F(e k ) is the formula (of J&) 

obtained by replacing free occurrences of x. by e, for 1 S t 5k.) 
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Leama 2.6 : For some constant c there la a procedure which given b, writes 
down the sequence 







,n« ? l,n-l' "•• *n,0» F 0,n' F l,n-1' '"• F n,0 vlthin tiBe 



[•^((•^(n^lf (nfl) )] c ; the length of the sequence Is * (T 2 (n + 2)) c(n " fl \ 



Proof : First compute the sequence 9 , !F_ . , . .., 7 n as In Lemma. 2.3. 
— — •— u»n x f B v i n,u 

Then for each k, ^ k ^ s, and for each F € 7 . . , write out the formula 

n— k,k 

k 

F(e ) ; each of these formulas will be of length £ L(n,0) and there are at 

most (T 2 (n))»(n + 1) of them. Then use the decision procedure for S to 

k -;'' 

decide each of the sentences F(e), and then consolidate the information 

on the tape. 

v 
The time used in deciding each sentence F(e ) (and returning the head) 

is £ 2T-(L(n,0)), eo the total time used In deciding truth of sentences in 

S is * (2T 1 (L(n,0))).(T 2 <«)).<© +1). 

So the time to write down 3* .9. ,..■.... 5 . plus the time used 

0,n* l t n-l' ' n,0 r 

in deciding truth of sentences is 3 

[TjCCTjdi + 2)) c(n+1) ^f + ■(2S 1 (^CBjO)))*CT 2 (a))«(n + 1) for .« as In 

Lemma 2.3. As in the proof of Lemma 2.3, the remaining time used IS 

polynomial in the space is which & n ^,7- _ ,, ..., JF, :* amd all die 

u,n i,n-i i*»o 
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k c(n+l) 

sentences F(e ) are written, which is £ 2(T 2 (n +2)) v 

L(n,0) £ (T_(n +2 ))° and so we calculate that for some other 

constant c, the sequence S^, \ nmV ... \ Q * F Q ^. .* Un -i F n>0 

can be computed within time [^((T^n +2 )) c < n+1 >)] c and its length is 

* (T 2 (n +2 )) C(n+1) . 



Definition 2,7 : For all n, k € N and every F € £ fc , define W(F) 
to be the set such that F = F . ii(-p)* 

Remark 2.8 : If n,k € N and F € ? n+1 fc and F* € ? n fc+1 and 1^ € S 
such that S h F(a.), then 

F' € W(F) » for some a fcfl € S, S H F*(a^ +1 ). 

We are now ready to consider the structure S = < S , n^ t ..., B^, e > 

k 

as defined in Chapter 3. For each n,k € N let s be defined on S and on 

n 

(S*) as in Chapter 2 and let E be defined on (S ) as in definition 

3.1.5 and let |a(n,k) be defined as in definition 3.1.2. 



Definition 2.9 : For each n,k € N, define 

f , = {V: N -> ? J for all but finitely many i € N, V (i) - F ) 



n, 



-72- 



For every V f ?* fc , define ||vf f - Min {i € n| for all J 2 i, V(j) = F . } 

— * k 
= the norm of V . For every f. € (S ) , let V -r be the unique member 

k n » f k 

of ?* k such that V -r (i> define* ff-Ci)^ 



for all i € N. 



* — * k 

Remark 2,10 : For every V € ^ . there exists some f. € (S ) such that 

V = V -= . Also note that if k = 0, we have I? A - 1 and so 
n,f fc n,0' 

K.oi- 1 - 



— — * k 
Lemma 2.11 : Let n,k € N and f-,g- € (S ) such that V 7 ■■ V - . 

K K n, t^ n *&k 

111611 *k n V 



Proof : If V - = V - then for every i fN, [f t (i) ] = [g, (i) ] , 
n^r^ n *S k k n nc n 

meaning that f fc (i) 5 8 k^* This ilB P lie8 tnat f t E 8 k * By Tneorenl 

3a - 8 *\SV'. D 

Definition 2.12 : Let n, k € N and V 6 5 fc and let F(x.) be a formula 

_ * v 
of q-depth £ n. Let f. € (S ) be such that V = V -z . Then we say 

n,£ k 

* — 
V t- F iff g V F(f fc ). By Lemma 2.11, this notation is well defined. 



it 

Remark 2.13 : If n 6 N and V € ? _ and F is a sentence of q-depth s: n, 

—————— n,u 
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then V h F iff 3* I- F. 



Definition 2.14 : Let n,k € N. Define the map EX: £ 4 . fc -» P(y_ k+1 ) 
(where EX stands for extension and P(A) is the set of subsets of A) as 
follows: If V € y^ k and V € y* k+1 , then V € EX(V) iff 

a) for each i € N, V*(i) € W(V(i)). 
and 

b) MVII * ||V.|| + n(n + k+ 1, 0). 

Lemma 2.15 : Let F(x^,) be a formula of q-depth £ n and let 

V € y* +1 k . Then V h 3x k+1 F(x fc+1 ) t » for some V* € EX(V), V h FO^). 

Proof of ^ ; 

Say that V is V . - 7 where f. € (S*) k , and that V is V - 

n+l,t k fc n » 8 k+l 

where g,.. € (S )*"■ and say that V - € EX(V .. 7 ) and 
Ki-l n » 8 k+l ■ * k 

V - h F(x, .,) where q-depth (F) £ n. 
n,8 k+l 

Let 1 a. We have V .. 7 (i) defines [f. (ii.. and V, - (i) 

n+i,r k k Tn-i n,g k+ ^ 

defines fe^Ci)]- and V - (i) € U^ j (D). By Remark 2.8 we 

can choose f k+1 (D € S such that [\ fl (i)l n - Cs lc _ | . 1L <i> 

So V - V 7 and V h F(x,^.). By Definition 2.12 

________________________ 

where we assume -^jFt^) is annotated by x p x 2 , ..., x fc . 
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S I- F("f fc+1 ). t and therefore S h Sac^jFCf^Xj^j). So 

V n + l,f k H ax fcfl F <W' 

Proof of .=» ; 

Say that V € y +1 fc such that V f Sk^^x^) where q-depth (F) * n. 

For i 2= I |v| | , V(i) defines [e l^y Therefore there exists f fc € (S ) 
such that f^i) - e k far 1 * | |v| | and such that V(i) defines l\(i) 1^ 
for i€N. SoVV^j. 

Since S J- 3x^^(1^, ^i)* ** cm find f € s 8Ucn that 
* t- F(f.,f). f. I , f., so the proof of Lemma 3.1.7 shows that we 
can find f^, € S such that (f fc ,f) % n fj^j «oA such that t^tt) - e 
whenever i * | Iv^ ■£ | | + |i(n + 1, k), By Lemma 3.1.8. 

<V>Vk + l * <V> 5 \fl * * f F( \fl>' 
V -r has norm 

clearly \ T •" F <*k+i>« For each *■ € N, T^ j (i) defines 

"■■■fc'jf X - UL'y. 

[f k (i)] n+1 and V n 7 defines [^(D^ Implying (by Remark 2.8) 

that V -= (1) € W(V j (i)). So V t € EX(V . £ ). □ 

"'^1 * ¥l ' f ii n,f k+l ' Bfl » e k 
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Lemma 2.16: Let F be the formula Q.x,Q x„ ... Q x G(x ) where G is 
1 1 £. £■ n n n 

quantifier free. Let V Q € ^ Q . Then 

S%F« (Q^ € EX(V ))(Q 2 V 2 € EX^)).. . (Q^ € EXCV^))^ > G). 

Proof : S h F ** V n I- F. By n applications of Lemma 2.15 we have 

V Q V F « (Q 1 V 1 € EX(V Q ))(V 1 I- Q 2 x 2 Q 3 x 3 ... Q^G^)) 

... <* (Q 1 V 1 € EX(V » ... (Q n V n € EX(V n-1 ))(V n V G(x" n ». D 



Theorem 2.17 : Say that T : N -> N is such that TH(3) can be decided 



in 



by some algorithm within time T.(n) and such that T,(n) * 2 for all n € N. 

Say that T 2 : N ■-» N is such that T 2 (k + k') * M(k,k') and T 2 (k) * k 

for all k,k' € N. (Assume T l is nondecreasing.) 

Then there exists an algorithm for deciding TH(S ) which operates 

within time [T.((T 2 (n +2)) )] for some constant d. 

Proof : By Theorem 1.4.2 it is sufficient to consider the sentence F of 

the form Q,x,Q_x ... Q x G(x ) where G is quantifier free and of length 
1 1 / ^ n n n 

at most n log n. The decision procedure proceeds in three steps. 

Step 1 : Compute the sequence 

\n« *l,n-l* •••' *n,0' E 0,n' F l,n-1' "" F n.O- By Jj * m& 2 ' 6 
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this can be done within time [T^T^n +2 )) C («+D)]C flnd the length 

of the sequence is ^(T-(n +2 |f* n . 

Step 2 : Compute |i(n,0) (say* in unary). 

n(n,0) = l^o.nl'^l.^ll'-^'^n-IA^ (X 2 (n)>n ' So ^ n »*> can *• 

computed and written down using at most (T 2 (n)) n more tape squares 

than those containing the sequence computed in Step 1. 

Step 3 : Say that 9 . - {V Q } . We want to decide if 

(Q 1 V 1 € EX(V ))(Q 2 ? 2 € SK^)) ... (^ € ^(.\.{^(\ I" G). 

To do this we have to have a way ©f writing dewn representations of 

* 

members of 9 . . for & 1 £ n. Our convention is as follows: if 
n— 1,1 

V € $* ±t then 8EP(V) is the sequence V(0), V(l), .... V(||v|j). 

Now if V Q , Vj, ..., V n is a sequence such that V, , 6 EX(V.) 
f or £ i < n (where * € 9 Q ), then since | |vJ | « and 
I lv ±+1 l | * | IvJ I + ji<n,0) we see that | fv ± | | * i*^(n,0) for * i £ n. 
So for each 0^, 1 £ i s n, set aside (L(n,0)). (l+i.|i(n,0)) additional 
tape squares; this is enough space to write down the representation of 
any member of ^^ ± of norm * i»n(n,0) (since L(n,0) » L(n - i, i)). 



-77- 
Clalm : There exists a procedure which given 

*n,0* Vl.l \n> F n,0' F n-l,l' — V Y ' Y ' aS inpUt * Whe " 

* 
y = REP(V) for some V € SK . ,, 0<i<n, determines, using 

no more space than the input takes up, whether or not y % € EX(y). 

Proof of Claim : Say that y is the sequence y(0)» y(1)> ..., Y(J) 

and y 1 is the sequence y'(0), y'(1). ••• Y'(J') *o* some J, J' € N. 

We first calculate i (say in unary) such that y(0) has free variables 

exactly Xq.x^ ..., x ± ; that is y - REP(V) for some V € y n . ifi » 

Assuming i < n, in order to ensure that y' € EX(y) we need only check that 

1) y' is a sequence of members of ?_ . . ..-■, and J* s.J + |i(n,0). 

2) Y'(J , )=F n _ 1 _ 1)i+1 and if J' > 0, then y'CJ'-D * Vi-l.i+r 

and 

3) for every ] i0 such that j £ J and j £ J' , we have y'(J) € W(y(j)). 

For every j such that J < j £ J*, we have y'.(J) € W(y(J)). 

1), 2), and 3) can be checked using no additional space, and so 
the Claim is proved. 
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Ncw to decide F, cycle through each quantifier apace appropriately. 

That is, use Che space set aside for *}- Co cycle through the representatives 

of members of EXCV-),, obtaining different values for ffttP'(V.)., the space 

set aside for Q 2 to cycle through the representatives of the members of 

each EX (V.), etc. For every particular value of V € ' fleoesed at, 

we have to decide <£aamWEBfW ) if V J- 0(x ). It is sufficient to be 

n n n 

able to test if W t- G A (* ) for each atomic formula G n $x ) occurring in 
nun u n 

G. But recall ttost .for «very 1 € U., V fi) is simply a conjunction of 



atomic formulas or negations of atomic formulas. ;8o V KG^fx ) 



iff 



for every formula F€$L of the sequence »EB(V ),€«€ W(F). So 

TH(S ) is decldable. Testing if *V +■ G uses only the space on which G 

and REF(V ) are written. 

The total space used in Steps 2 and 3, including the output of 

Step 1, is £ (T 2 (n + 2)) c(n+1) + (T^Cn)) 11 + n«aO»,0)).(l + n.(i(n,0)) 
output of Step 1 Step 2 Step 3 

(the n log n space on which G is written is insignificant). The time 

used by Steps 2 and 3 is at most exponential in this bound. Since 

H(n,0) * (T 2 (n)) n and L(n,0) * (T 2 (n +2 )) c(n+1) , we have that the 
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total time used in all three steps is <■ [^((T^n +2)) )] for 



some 



constant d (since the length of a sentence is > 0) . □ 



rollary 2.18 : Let s , s 2> c € N, s 1 ^ 1 an d s 2 S 2, such that TH(S) 



Co 



can be decided within time 

„cn 2 C ^ nH " k ^ 

■' {height s ' k height s 2 

2 y and such that M(n,k) ^ 2 7 for 

all n,k € N. 9 c'n 

2*' <; hei s ht s l + s 2 

Then TH(S") can be decided within time 2 J for 

some constant c'. 



Proof: Immediate from Theorem 2.17. 



□ 
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Sectlon 3: Results riwut Other Kinds of Direct Products 

In this section we state soae results about other kinds of direct 
products, thus giving quantitative versions of some additional theorems 
of Mostowski and Fefermaa and Vaught [ltos52, TV59}. We will not present 
proofs here, but our results follow fro* extension* of the ideas i» 
Chapter 3 and the proceeding parts of this Chapter. 

Definition 3.1 : Let I be a nonempty set, and let (** ' \ i € I) be a 

collection of structures for £, indexed by I; Say that 

S< i > = < s (i >, »{*>, R<*> .... 9%\ e (i) > for all i € I. Let 

D = (f: 1 -» U S (i) | f(i) € S (i) for i € I) . For each j, 1 £ j * 1, 

i€I 

** fc 1 

define R = D J as follows: if f . ,€ D J , then f. € R, iff 
j tj tj J 

f (i) € ft* 1 * for all i € I. Define e € D by e(i) = e (i) for all 1 € I. 

Define the *r™«* direct Mroduct of the system (8 ( | i € I) by 

STR0NG(S (i) | i € I) - < D, Rj, R 2 , ..., R^, e >. 

Let D' £ D be the set ( f € D | for all but finitely many 1 € 1, f(i) - e ( '} , 

and let R' be the relation R, restricted to (D') J 

for 1 £ j £ i. Define the wa«k direct- product of the system 

(S (i) | i € I) by WEAK(S (i) | i € I) «<D«, R^, R£ .ft J, e >. 
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If I is finite, then STR0NG(8 (i) | i € I) = WEAK(» (1) | i € I). 

If we take I to be N and S^ = S for some fixed structure » 
and all i € N, then we denote STRONG(S (i) | i € N) by S W and call it 
the ^™"? «Hr« e t oorar of *; WEAK(S (i) | i € N) is **, the weak 
direct power of S, which was defined earlier. If P is a nonempty 
collection of structures, then STRONG (P) is the class 
{STRONG(S (i) | i € I) | I is aset andS (i ' € P for i € 1} and 
WEAKfP^ is the class 

{WEAK(S (i) | i € I) | I is a set and » (i) € P f or i € 1} . 

Mostowski shows that if TH(8) is decidable, then TR(8 U ) is decidable. 
Feferman and Vaught show that 

TH(STRONG(P)) = TH( { STRONG (» ( ^ | i € I) | I is a finite set and » € P for i € I}), 
and if TH(P) is decidable, then TH(STRONG(P)) and TH(WEAK(P)) are decidable. 
We can prove stronger versions of these theorems. 



Theorem 3.1 : Let S be a structure and let M(n,k) be defined as before 
(Definition 2.2.5). Say that T^: M -» H is such that TH(S) can be decided 



-82- 

by some algorithm within time T.(n) and such that Tj^n) * 2 for all 

n € N. Say that T 2 :N -» N is such that T 2 (k + k') = M(k,kV) and 

T 2 (k) * k for all k, k' € N. (Assume T l is nondecreasing.) 

Then there exists an algorithm for deciding 1H<» W ) which operates 

within t*. IT^C +2 ))*)] " for .o» con.t m t d. 

Definition 3,2 ; IfP is a collection of structures, let 
INFSTRONG(P) - {sraCMG(S (i) | i € I) | I is an infinite set and 
S (1) €P for i € I). 

Let INFWEAK(P) - {WEAK(» (i) | i € I) | I is an infinite set and 
S (i) € P for i € 1} . 

Theorem 3.3 : Let P be a nonempty collection of structures and for each 
5 6 P, let WL(n,k) be defined for 5 as before (Definition 2.2.5). Say 
that T.: N -♦ N is such that TH(P) can be decided by some algorithm 
within time T-(n) and such that T^n) * 2 n for all n € N. Say that 
T 2 : N -» N is such that T £ (k + k») * *^(k, k') and T 2 (k) * k for all 
k, k* € N and all S € P. (Assume T 1 is nondecreasing.) 

Then there exists algorithms for deciding TH(STRONG(P)), 
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TH(INFSTROJW(P)), TH(WEAK(P)), and TH(INFWEAK(P)) which operate within 
time [T 1 (2^ T 2^ lri2 ^ ) ] d for some constant d. 

It is important to note that in Theorems 2.17, 3.1 and 3.3, the 
decision procedure that is produced is obtained effectively from the 
one that is given. For instance, in Theorem 3.3 TH(STRGNG<P)) is 
completely determined by TH(P). 

Now let P be the collection of finite cyclic group structures. 
Since every finite abelian group is isomorphic to a finite direct 
product of finite cyclic groups, the first order theory of finite abelian 
groups is the same as TH(STRONG<P)). TH(P) is decidable, and we could 
have used the technique involved in proving Theorem 3,3 to prove Theorem 
3.2.8. Every finitely generated abelian group is isomorphic to a finite 
direct product of cyclic groups [MB68], So if P' is the collection of 
cyclic group structures, then TH ( STRONG (P 1 )) is the first order theory 
of finitely generated abelian groups. But using results of [Szm55] it 

can be shown that TH(P) - TH(P'), and so by Theorem 3.2.8 we see that TH(STRONG(P*)) 

,2 cn 
can also be decided within space 2 Z for some constant c. 
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Chaoter 5: A Lower Bound on the Theories of Pair ing Functions 

Section 1; Introduction 

A pairing function is defined to be a one-one map p: N X N •* N. 

The language £ we shall use to talk about pairing functions in this 
chapter is the usual language of the first order predicate calculus with 

the formal relation p(v r v 2 ) = v r If p: N X N. •* » is a particular 

pairing function,- then we can interpret formulas and sentences of X 
in the structure < S, p > in the obvious way; by a P~ structure we shall 
mean a pal* < II, p > wHefe- p is a pairing fune ties. Bet & be the 
collection of alt f -structures. Not* that although equality is not a 
formal predicate ef *, ** can define equality in P by writing 
Vx(p(v 1 ,v,) = x ** p(v 2 ,v 2 ) - x), which we will henceforth abbreviate 

as v = v„ (where v- and v* represent formal variables). In {Ten74] 

Richard Teimey refers to some unpublished results of Hanf and Morley 
which show that TH(P) is undecidable. We will present our own proof of 
this in Section 2,- Tenney also proves that the theories of a large 
class of pairing functions, including the most common examples, are in 
fact decidable; however, none of the decision procedures for P-structures 
that he arrives at are elementary recursive. 



In an earlier version of Tenney 's work [Ten72] he presented some 
elementary recursive algorithms which were supposed to be decision 
procedures for seme theories of pairing functions. We pointed out to 
him that this was impossible, and he has since written a corrected 
version [Ten74] in which all the algorithms presented are non-elementary 
recursive. 
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The major result of this chapter will be that this is an intrinsic 
difficulty of pairing functions. We shall show that no nonempty 
collection of P-structures (and hence no single P-structure) has 
an elementary recursive theory. 

.•V ti 

Definition 1.1 : Define f : N -» N by f(i) = 2 2 j helg ' *. That is, 
f (0) = 1 and f(i + 1) = 2 f(i) for i a 0. 



Theorem 1.2 : Let C be a nonempty collection of P-structures. Then 
NTIME(f(n)) ^ -TH(C). 

Theorem 1.2 will be proved in Sections 3 and 4. Using the methods 
described in Chapter 1 for proving lower bounds, Theorem 1.2 yields the 
following corollary. 

Corollary 1.3 : For some constant c > 0, the following is true: Let C be 
a nonempty collection of P-structures and let 1R be a nondeterministic 
Turing machine which recognizes TH(C). Then for infinitely many n, there 
is a sentence in TH(C> which SR takes at least f (en) steps to accept. 

We have remarked that Tenney shows that many pairing functions have 
decidable theories; in fact, some of the decision procedures that he 
presents run within time f(c'n) for some constant c'. So the lower bound 
of Corollary 1.3 is achievable (except for the value of c). 

We conclude this section with some simple generalisations of 
Corollary 1.3. 
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Definition 1.4 : Let n be an integer > 2. Then an n- ting function 
is a one-one map p: N* -> N. JE n , the language for n-Iing functions, 

ia the language of the firet order predicate calculus with the formal 
predicate pO^.Vj, .... v B > - v^. An n-structure ia a pair < N,p > 

where p ia on n- ling function. 

Corollary 1.5 : Let n > 2 and let C be a nonempty collection of n-structttres. 
Then TH(C) has no elementary recursive decision procedure. 

Proof : Assume for convaniance that n - 3; the other cases are handled 
similarly. If p is a 3- ling function and a € », define the pairing 
function p a by p a (a 1 ,a 2 ) - p(a,a lf a 2 ). If F is a sentence of I (the 

language of pairing functions) and x is a variable not occurring in F, 
define F'(x) to be the formula of Z^ obtained by replacing every atomic 
formula of F of the form p(v lf v 2 ) - y^ by pCx^.Vj) - v y It is eaey 
to see that for arty 3-structure < H,p > and any a € K, 

< N, p > h F' (a) « < N, > H F. 

Now let C be a nonempty collection of 3-structures and define 
C = {< N, p >|<N, p>€C anda€ir);Ciaa nonempty collection 
of P-structures. Let F be a sentence of X. Then C H F *» for every 

< N,p > € C and a € N, < N,p > f- F « f or every < N,p > € 0* and 
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a £ N, <N,p > I- F'(a) ° C I- VxF'(x). An elementary recursive 

decision procedure for TH(C') would therefore yield an elementary 
recursive procedure for TH(C), contradicting Corollary 1.3. □ 
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Section 2: Some ffgdayidahility Reaults 

Our goal in this aection is to prove that the aet of sentences 
true of all P-etruc tores Is not recursive, arid that acme individual 
p- structures also have undecidable theories. These proofs are due to 
the author, Jeanne Ferrante, and Robert Hossley. 

Definition 2.1 : Let F REIj (^ 1 »x 2 ) be the formula 

3x 3 ax A (p(x 1 ,x 2 ) m x 3 A p(x 3> x 4 ) - x 4 ). 

If S = < N,p > is a P-«atructHra, define 
REL(S) = {Ca 1 ,a 2 ) € N 2 | » ¥ f^U^)} . 

Let N ^ N be the set «f even, nonnegative integers, 
e 

Lemma 2.2: Let R £ N X N . Then for some pairing function p, 

1 " ' e e 

REL(< N,p >) = R; furthermore, we can choose p to be onto as well 
as one- one. 

2 
Proof : Let (a-.b.), (a 2 ,b 2 ), ... be an enumeration of N such that each 

+ 
pair occurs exactly once and auch that b 4 21 for each i € N . (For 

instance, we can cbooae an enumeration (0,0), (0,1), (1,0), (0,2), (1,1), ., 

where the numbers grow sufficiently slowly to ensure that b 4 2i.) We 

will now define the sequence p (a 1 .»b^),p(a 2 '» b 2 ), .... 



-89- 



Let n € N + and assume that pCa^t^) has been defined for 



< i < n; we now define P( a n » b n )« 



Case 1 : (a ,b ) € R. Define P( a n > b n > " 2n « 



Case 2 : b - 2i + 1 and a^ - 2i and < a 1 » b i > 6 .*'• Define P( a-, b n ) » b n . 

Case 3 : Otherwise. Let m be the least member of N such that 

a) m is not equal to either 2i or 2i + 1 for any i such that (a^b^,) € R. 

b) m * (p^.bp | i< n} 
and 

c) m 4 b^. 

Then define P( a n > b n ) = m « 

We first show that p is one-one. Say that p(a ,b ) = P'(a k> b k ) » J. 

If J = 21 where (a i ,b i ) € R, then both p(a ,b ) and PC^.b^ must have 

been define via Case 1, so j = k = i. If J - 2i + 1 where (a^b^ € R, 
then both p(a.,b ) and P(\»\) miat have been defined via Case 2, so 

b = b. = 2i + 1 and a. = a, = 2i. If we do not have either J = 2i 
j k j Tc 

or J = 2i + 1 where (a^b^ £ R, then both p(a ,b ) v4.P(.\,\) «■»■* 

have been defined via Case 3; by Case 3b), we must have j = k. So 
p is one-one. 
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We will now show that p Is onto. Let m € N. Assume that p 
is not defined to take on the value m via either Case 1 or Case 2. 
Then we do not have m - 2i or n - 2i + 1 where (Sj^) €'R. Let 

S = {(a,b) € R 2 | b € K and a £ S a and b 4 m} . p cannot have been 



defined on any member of S via Case 1 or Case 2, so p most have 
been defined on every member of S via Case 3. Since S is infinite, 
[(a,b) | p is defined on <a,b> via Case 5 and b 4 m) is infinite. So 
p eventually takes on the value m via Case 3, and hence p is onto. 

It remains to show that REL(<N,p >) - R. Say that (* 1 »».|) € R. 

By Case 1, p(a i> b i ) - 2i, and by Case 2 (since Case 1 doesn't apply to 
(2i, 2i + 1)), p(2i, 2i + 1) - 21 + 1 and hence (s^bj) € REL(< N,p >). 
Say that (Sj.h.) € REL(< N,p >). Then for some c 6 N and some j € N 

we have (pU^b^.c) - ( a 4» c 4) and p( V c j> " c j* Since ** can,t h,tve 
c =2j, p cannot have been defined on (a.,c.) via Case 1, and looking 

at Case 3c), we see that p cannot have been defined on (a.,c.) via Case 

3. So p was defined on (a ,c ) via Case 2. This means that e '- a, + 1 

and a^ = 2k where (a,^) € R; that is, pU^b^ - 2k and (\,\) € R. p(* v \) 

cannot therefore have been defined via Cases 2 or 3, and therefore we have 

that i = k and p(a t ,b i ) € R. □ 



Definition 2.3 : Let £. be the language of the first order predicate 



-91- 

calculus with only a 2-place formal predicate REL. Define the class of 
structures for & v C - {< D,R > | R = D 2 and D = domain R} (where domain R 

for a 2-place relation R means (a | for some b, (a,b) € R or (b,a) € R}). 



t 
Lemma 2.4: (Kalmar [cf. Ch56]). TH(C) is undecidable. 



Theorem 2.5 : a) TH(P) is undecidable. 

b) There exist particular P-structures with undecidable 

theories. 

Proof ; If F is a sentence of J^, let F* be the sentence of I 

obtained in the following way: 

1) For every quantification Qv in F, change it into a quantification 
over the values of v which satisfy a* l a *2 (F REi/ X l ,X 2 ) A (v = x x V v = x 2 >), 
and 

2) Replace each atomic formula of F of the form REL(v 1 ,v 2 ) by 



3x. 



,3x.(F nm (x.,x 4 ) A x. = v. A x, - v 9 ). (We are assuming that neither 
1 2 REL 1 ■ Z 1 J- *■■*.-.. 



x. nor x„ occur in F.) It is easy to see that for any » € P and sentence 
F of JL, < domain(REL(»)), REL(S) > I- F » S h F'. 



+ Actually, the theorem as stated by Church as TH({< D,R > I R c D }) 
is undecidable, but Lemma 2.4 follows immediately from the proof. 
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Proof of (a ); We will show that C I- F « P *• F'. 

C H F =* for all < D, R > € C, < D, R > I- F =» 
for all S € P, < domain (REL(*)), REL(S) >"»■ F =» 
for all » € P, * h F' =» P I- F*. 

Conversely, P «- F« * for all S € P, 8 I- F' =» 

for all 8 € P, < demain(REL(S)), REL(S) > I- F =* 

(by Lemma 2.2) 

for all < D,R> 6 C smeh thai: D *= * e » < &#R > **. *"• 

By the Skolem-Lowenheim theorem [cf. Ken64], this implies that for ever? 

< D,R > € C, < D» R > h F, ljnplying C H F. So C H F «• P I* F'. 

Hence, a decision procedure for TH(P) would yield one for TH(C), 
contradicting Leassa 2.4. 



Proof of (b) ; It is easy to see that there exists some R c H X N 

■—■—""Nil III I IIIIMaMAMiB C C 

such that N - domain R and TH(< N ,R >) (in JL) is undecidable. (We 

e e i 

can, for example, choose R to be an equivalence relation so as to make 
TH(< N ,R >) undecidable, as described in Section 4 of Chapter 2.) By 

Lenma 2.2 we can find 8 » < N,p > such that REL(S) * R. Then for any 
sentence F of £. we have < H ,R > b F » S ¥ F'. So TH(8) is undecidable. D 

Remark 2.6 : Let P' * {< H,p > € P j p is onto}. The proof of Theorem 

2.5 shows that (a) TH(P') is undecidable and (b) TH(&) is undecidable for 
some S € P\ 
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Section 3; Construction of Formulas Which Talk About Large Sets 

Our goal in these next two sections is to prove Theorem 1.2, i.e., 
thatNTIME(f(n)) £ A TH(C) for any nonempty collection C of P-structures. 

We shall do this as follows: Let SCR be a nondeterministic Turing machine 
over the alphabet S. Then for every w € £*" we will produce a sentence 
F of £, such that for any P-structure S, S h F » 2R accepts w within 

time f(|w|); furthermore, the time it takes to produce F w will be poly- 
nomial in |w|, and the space needed will be linear in |w| . If 2K 
operates within time f(n) and C is a nonempty collection of P-structures, 
then we have C H F «* SR accepts w within time f(|w| ) *» 3K accepts w, and 

hence NTIME ( f(n) )* £ TH (C ) . 

The way F will "say" that SCR accepts w within time f(|w|) is as 

follows: We regard the instantaneous configuration of a computation of 
2Jt on w at any time as a string of length f(|w|), and hence the 
concatenation of the first(f(|w| + 1) / f(|w| )) (which is * f(|w|)) 
successive instantaneous configurations is a string of length f (|w| + 1). 
F will "say" roughly that there exists such a string of length f(|w| + 1) 

which contains an accepting configuration. In order to write such 
sentences as F , we will first have to be able to write down formulas of 

£ of length proportional to n which allow us to describe the basic 
set-theoretic relations on the subsets of an ordered set of sike f <n + 1). 

The above is an intuitive outline of our .approach. The ideas for 
this outline first appeared in Meyer's proof that WSIS is not elementary 
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recursive [Mey73], and also occur infFiR74], [Fer74], [KS72], [SM73], [Rob73],fSto74], 
In the rest of this section we shall sh«r how to write formulas of length 
proportional to n which "talk about" sets of sise f (n + 1) ; these 
theorems do not appeal to any of these previous papers since the 
development in this section is necessarily intimately connected with 
the nature of F-structures. In Section 4 we shall present a development 
along the lines of Meyer, etc., which shows how to use the formulas 
derived in Section 3 to prove Theorem 1.2. 

Let < R,p > be a P-structure. We first define partial functions 
JL: N •* N and r: H-* N as follows: for a € N, *<a) - b if for some 
c € N, p(b,c) - a; r(a) - b if for some c € N, p (c,b) - a. Since 
p is one-one, r and A are indeed partial functions. Clearly r and i 
depend on p, but it will always be clear from the context what pairing 
function a particular r and i come from. Let a €"(r,i). be a string; 



we define the partial function f : N -♦ N in the obvious way, namely 
if \ is the empty string then f^(a) - b iff a - b, and if or is 

la* (rcr") then f "i 4 !., (»r«f .). Henceforth we will use a ambiguously 

o cr q 

* 
to designate both the string in (r,l) and the function f ff . 

Let FjCx-.Xj) be the formula 3x 3 (p(x 2 ,x 3 ) - x^ and let F r (x 1 ,x 2 ) 

be the formula ax 3 (p(x 3> x 2 ) » x ). Then for any 3 fP and any a,b € N, 

S h F A (a,b) iff X(a) - b and 8 «- F r (a,b) iff r(a) - b. Since we will 

be expressing properties using the partial functions r md 1, and since 
we will be interested in writing down formulas that define these 



-95- 

properties, it is important to realize that we will be implicitly 
using the formulas F^ and F f . 

Definition 3.1 : Let < be the reverse lexicographical ordering on 

{r,JL}*. That is, o^ < o 2 if either a 2 = a^ for some o^ € {r,&) , 

* 
or if a, = a'jfccr and a_ = a^rcr for some aj, ct*, a € {r,A} . 

ct 1 < a, means ct. ■< a_ and ex. ?* cj 2 . 

All the properties mentioned in this chapter will be with respect 
to P. 

Definition 3.2 : For each n € N, we define the property 0RD n (x,y lf y 2 ) 

as follows: let < N,p > 6 P, let a, b^ b 2 € N. Then 

<N,p > I- ORD (a,b ,b 2 ) iff there exists cr^o^ € {r,A} such that 

(Dl^l = |ff 2 l = f(n) 

(II) CT 1 « <7 2 

(III) CT.a = b_ and a 2 a = b 2 



Remark 3.3: < N,p > H ORD (a,b,b) iff for some a € {r,A} , 



f(n) 



= f(n) and a& = b. Clearly |(b| < N,p > H ORD n (a,b,b)} | £ 2 ^ ' = f(n + 1) 



Definition 3.4 : For n € N we define the property FULL n (x) as follows: 
let < N,p > € P, let a € N. Then < N, p > H FULL n (a) iff 
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(b | < N,p > * ORB (a,b,b)}| * f(n + I), 



n 



\Mma 3.5 : Let < N,p > be a structure and let n € N. Let 

a., a,, .... a be the increasing (with respect to <) sequence of 

those members of {r,i} of length n. Let bj, b^, ..., b be a sequence 
of (not necessarily distinct) members of N. Then there exists a € N such 
that CT.a * b. for 1 £ i * 2 n . 

Proof : (by induction on n). 

Let < M,p > be a restructure. Lemma 3.5 is true if n - 0, since 



we can choose a - b.. So assume the Lemma for n; we will prove it for 

n + 1. 

Let b, , b* b., bi, . .., b , b* be a sequence of members of N 

n+l 
of length 2 . Define the sequence c., c-,, ..., c by c± " P( b ,»bp 

for U i £ 2 n . Let a., a», ..., a be the increasing sequence of 

* 

those members of (r,i) of length n. By the induction hypothesis, we 
can choose a € II such that o f - e^for 1 s i £ 2°, By definition of <, 

ia, , re,, Aff 9 , ra«, ..., *cr , xa is the increasing sequence of members 
i l «& ^ 9 n ^n 

of (l,r) of length n + 1. Since Ao.a " Ac. ■ b. and r0.a ■ re. * b', 
a is the element we were looking for. Hence we are done. D 
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Lemma 3.6: Let <N,p > 6 P and let a, n € N. Then the following two 
statements are equivalent. 
(I) < N,P > H FULL n (a) 

(II) For every a' € N, if [(ORD n (a,b,b) * ORD^a 1 ,b,b)) for all b € N] 

then [(ORD n (a',b,b) => ORD n (a,b,b>) for all b € M] 

Proof : 

(I =» II): Say that FULL (a) holds in < N,p > and that a' € N has the 

property that for all b £ N, <N,p > K ORD n (a,b,b) =>< N,p > I- GRD^a' ,b,b). 

We have f(n +.. 1) = |{b| < N,p > I- ORD n (a.b,b)} | * |{b| <N,p >K)RD n (a' ,b,b)} 

£ f(n + 1). Hence < N,p > H ORD^a'b.b) =» < N,p > h ORD^a.b.b). 

(II => I): Say that II is true. Let A c N be a set of cardinality f(n+l) 
such that {b | < N,p > h (3RD (a,b,b)} c A. By Lenma 3.5 we can choose 
a' € N such that {b | < N,p > »■ ORD^a' ,b,b)} = A, so 

{b | <N,p > I- GRD (a,b,b)}£ {b | < N,p > h ORD (a 1 ,b,b)} . So by II, 
n *# ■. . 

{b | <N,p> h ORD (a,b,b)} = {b | < N,p > I- ORD^a' ,b,b)} - A. Hence, 

|{b | <N,p » ORD n (a,b,b)}| = |a| = f(n + 1) and so < N,p > H FUI^ n <a>- D 

Remark 3.7 : If < N,p > I- FULL n (a), then clearly aa is defined for 
every a of length f(n) ; furthermore, if 1^1 = k 2 l - f(n) and <* l 4 ^ 2 , 
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then o^a f o 2 &. Hence ((b^bj) | < H,p > I- OfcD^a.b^b^} is a linear 
ordering on the set (b | < M,p > I- ORD n (a,b f b)) of cardinality f(n + 1). 



Lenma 3*6 showed how FUIX can be expressed freer the property ORD ; 

n n 



the purpose of Lemma 3.8 is to show how CRD - can be expressed from 

CUD and FULL . Let < M,p > € P and let a,b.,b, € H Lesasa 3.8 says that 

n n * * ■ • 

< N,p > I- 0RD tt j.i( tt » b i » b ?^ if *"** 0Bly if tRara •**•*» *° 1 "* c e K w^lcfe 

"codes" strings a v ° 2 € t r '^ of laB * th f < n + l > ,uch tRat a l* " b l 

and a.a - b. and a l < cr.. To see how this coding is done, examine Figure 1. 

Every node in the tree in Figure 1 represents a (not necessarily distinct) 
member of N. The value at a node is p of the values of the two sons 
(if they exist); for instance, P(g,h) - c. In order for c to code the 

strings Cj - 7 f / n+1 \ ••• Y2?! and a 2 - Gf^j^ ••• * 2 8 1 ifc is necessary 
that d = v. ... Y 2 Y;|* and e. - 6 ... 6 2 & l a for l * i S f * n "*" l *» note 

that c may code numerous pairs of strings. In order to say that c codes 
strings o\»°2 suclx tnat ff i(a) - b. and cr 2 (a) » b 2 and <j^ < a 2 , one has 
to be able to talk about the nodes labelled by d^e^d^e,,,..., a f/n+l) 

and their ordering from left to right, and for this reason we insist that 

c-, c 2 c f<'n+i^ a11 be diBtinct so tna t we can talk about their 

ordering using ORD . 



-99- 




; f(n) 
levels 





f(n+l) 



f(n+l) 



Figure 1: 
Illustrating Lemma 5.3.8 
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Lenma 3.-8 : Let < N,p > € P, let n € N, let a.b^bj € N. Then 

< N,p > H ORD^Ca.b b ) if and only if there exists c € N such that 
n+l 1 . * 

the following four facte hold. 



1) < N,p > I" FULL n (c). 



Let ©be the linear order imposed on the set (b | < N,p > »" 0RD n <c,b,b)} 
by GRD . Let c lt c 2 , .... c f(n+1) be the element, ordered by <g) listed In 

increasing order (with respect to (§)). 

2) lie is defined for 1 s i s f(n +1). 

Define the sequence d Q ,d 1 d f(n+l) by d " * and d i * ii& i f ° r 

< i s: f (n + 1). Define the sequence eg.e^ ..., •{(n+i) **? e o * * 

and e - ric J for < i * f (n + 1) (rlc is defined since Ale is defined). 

i i — 

3) For < i * f(n + 1), either & i - rd t .i or d i * ^l-l* "^ eitn * r 
e i = re i-l or e i * S-l- A1 *°' d f (n+1) " b l "^ e f(n+l) " V 

4) Either d - e for all i, s i s f (n + 1), or there exists some i, 

' < 1 * f(n + 1) such that 4.1) d - e f or = J < i and 4.2) 
d = Jtd _ and e t - *«£_!' 
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Proof : Fix < N,p >, n.a.b^ty 



(If): Say that for some c € N, 1) through 4) hold. If < i ^ f(n+l), define 

v = i if d = M, , , and y. =r if d. - rd. . and d ^ jW. .. If 
'i i i-1* i i i-1 i i-l 

< i £ f(n+l), define 6 i = r if e ± = re^, and 6 ± - i if e^ = Ae^ and 

e i * re i-l" Define °V C 2 € (r,A) by CT 1 = Y f(n+1)'" Y 2 Y 1 and 

a 2 = 6 ff +1V " 6 2 6 1' Tt is clear from 2 ) and 3 ^ * hat °l a = b l ""* 

a„a = b.. We wish to show a. < a^. If a^ 4 c? 2 , then for some i we have 

Y - 6 when < j < i, and ■y J . 4 6 ± . So dj = e^ for < j < i. If 

d ± = e^ then y^ x = d ± = e ± = 6^ = 6^, so Jd ±-1 = rd ±-1 - d^ 

By definition of y' v Y t - ^ and so o^< ay If d ± * e^ then by 4.2) 

d - id . So Yj^ = A and a 1 < cr 2 . 

* 
(Only if): Say that < N,p > > ORD^U,^^). Let OyC 2 € (r,A) be 

such that a. < a 2 and jo-J '» |a 2 | = f(n + 1) and o^a' » bj and a 2 a = b 2 « 
Say that a. is Yf/^j^s**' Y 2 "Vi and that ct 2 is 6 f / n+1 )*" 6 2 6 1 where 
Y. € (r,i) and 6 € {r,A} f or < i < f(n + 1). Define the sequence 
d Q ,d r .... d f(n+1) by d Q = a and d t = Y^^ for < t * f(n + 1). 
Define the sequence e^e^ ..., e f /_ +1 \ b y e - a and e,^ ,.= ^^ e i«i 
f or < i £ f(n + 1). Clearly d f(ft+1) - ^ and « f(n+1) " V 

Define the sequence g-,g 2 , ..., 8 f / n+1 \ b y &± = p ^ d i» e i^ for 
1 s i s f(n + 1). Define h^hy ..., h f(n+1 ) € N as follows: let t^ be 
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any element of N; for 1 * i< f&a + I) l»t h^ be such that 
P(g 1+1 ,h i+1 ) * PCgj,^) for any j, 1 s j s i. <h 1+1 can be chosen in 

this way since p is one-one.) Define the sequence ©f distinct members 
of V--e it c 2 , .... c f(B+1 )^- ^y « t - PCg^^) for l s i s f (n + l). 

Clearly d x > Mc, and e, - r£c. for I s i s f ( B + 1). By Lemma 3.5, 
.1 l l x 

we can find c € U sudt that if «.,«_, . .., Of^ .^.^ are those embers q£ 
(r,i} of length f(n) listed in increasing order, then c. * «. c for 
Mii f(n -f 1). Clearly c satisfies properties 1), 2), and 3), 



If ct. - ct_, then d ■ e for s i s f C*» «*• 1). Otherwise e. < O- 

implies that there exists i, < i £ f(n + 1), such that y ■ 6 

if < j < i, and y* "* ^ and $ 4 " r « T»l» ««ans that d. ■ e if 

< j < i and d = ^<_i *>*1 * « re 4.i» *° *) &•'!** also. O 



Lemma 3.9 ; There exists a sequence of formulas of £ 

^2 (x»y 1 »y 2 ). 3*£ 1 (*.y 1 »y 2 ) ^ *•* 

(!) C3RP u (x.y 1 «y 2 ) defines the property ORD for n € N. 
(II) There is a procedure which given a € Ji computes ORD within 
time polynomial in n and space linear in n. 
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Proof : Define OR£ (x,y 1 ,y 2 ) to be 

[y = y 2 A az(p(z,y 1 ) = x V pfr^z) - x)]V p(y r y 2 ) = x. 

If we have ORD defining ORD , then by using Lemma 3.6 we can obtain 
a formula FULL (x) which is of length proportional to the length of 

ORD and which defines the property FULL . Lemma 3.8 therefore gives 
n n 

a way to define ORD . using ORD . (This is completely straightforward 

if one notes the following fact: in Lemma 3.8 we occasionally quantify 

over i, Hi £ f(n + 1), but this can be expressed indirectly as 

i t 

quantification over the ordered set {b | 0RD n (c,b,b)} ) . 



If one used Lemna 3.8 in the simplest way to write down 0RD n|1 

using sub formulas ORD , then since ORD would occur more than once in 

2 
ORD . , , the length of ORD would be at least proportional to n . We 
n+1 n 

can, however, use a result due to Fischer and Meyer [cf. FiR74] to 

obtain (using Lemma 3.8V a formula ORD ; of length proportional to n 

which defines ORD for all n € N + . This result is stated formally and 
n 

is proven in Appendix 1. Thus by Theorem A. 2 of Appendix 1, we can conclude 
Lemma 3.9. ^ 



It is at first difficult to see how to use Lemma 3.8 to write ORD n |1 
using pm. as a sub formula, since the free variables of ORD^ are fixed 

and we might wish to use formulas similar to ORD but with different 
free variables at different places in ORD n|1 . O&e way is by under- 
standing the phrase "using ORD as a subformula" to mean using 
formulas like ORD but with the variable names changed. Another way 

is by the following trick: Say we, have . ; a formula. F(x»3?) and we wish 

to have a formula G(y,z) such that F and G define the same property. 

We can let G be Vx 1 ,Vx 2 ((x 1 = y A x ? = z) -> VxVy((x = x x Ay- y 2 > -» F(x,y))), 
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Corollary 3.10 : There exists a sequence of formulas of £, 

FULL (x), FULL -(x). ... such that 

(I) FULL. (x) defines the property FULL for all n € M. 
n n 

•4- 
(II) There is a procedure which given n € H computes FULL within 

time polynomial in n and within space linear in n. 



Proof : Use Lemma 3.6 to express FULL using OKD for n € tt. 



Lemma 3.11 : There exists a sequence of formulas of X, 
DIST Q (x,y-,y^), DXST <x.y-«y^) t ... such that 

I) If S € P and n # a,b 1# b 2 € K, then * »• DLST (a.^.b^) «• 

(1) 5 H FULL (a) 

n 

(2) S h MD B (a,b 1 ,b 2 ) 

(3) The distance from b, to b 2 in the ordering determined by GKD 

is exactly f(n>. 

II) There is a procedure which given n € B computes PIST within time 

polynomial In n and space linear in n. 
Proof : Let DIST Q be p(yj,y 2 ) '- x A y ■ 4 j 2 . 

Let 8 € P, wQt , a, bj, b^ €■». We wish to say that * J- FULL (a) 

and |{c 6 M | c 4 bp and 3 .K eRD^Ca^bj^c) and 3 ** GRD £a,o,Jj^) | « f(n). 

(This implies that * h CRD (a,b,,b_).) But by Lemma 3.5, this will be true iff 

n a * • . 

S V FUtL (a) and there is some c # 6H such that *¥ FULL ,(c r ) and such that 

n ■■■■.-■ tt"*l ..'< 

for all c € TS, 
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es MKD .(c'.c.c)) « (c 4 \ and S H ORD^a.^.c) and S h ORD n (a,c,b 2 )). 

We can therefore write down a formula DIST^ x.y-^yO for n € N (by using FULL^, 
ORD FULL . and ORD n _ 1 ) such that (I) and (II) are satisfied. D 

Definition 3.12 : For all n € N, let SET^x.y^yp be the property 
such that for S € P and n,a,b 1 ,b 2 € N, S I- SET^a.b^) .«• 
8 I- FULL (a) and S H (3RD (a,b 2 ,b 2 ) and » h CRB^O^.b^b^. 

Lemma 3.13 : Let S € P and let n,a € N such that S b FULI^U). 

Let A £ (b | & h CRD (a,b,b)} . Then for some b 1 € N, 
A = (b 2 | S h SET n (a,b 1 ,b 2 )}. 

Proof : Say that » H FULL (a) and A c {b | S t- ORD n (a,b,b)} . Let A 1 c N 
be such that < |-A'| * f(n + 1) and A - A' A {b j » h ORD n (a,b,b)} . 
By Lemma 3. 5 we can find some b_ € N such that 
A' = (b 2 | S h ■C&D n <l> li b 2 ,b 2 )}* Hence, A = {b 2 | S h SET^a,^,^)} . □ 

Lemma 3.14 : There exists a sequence of formula? of X,SET (x,y 1 ,y 2 ), 
SET^x.y-.yj), ..- such that 

(I) SET (x,y 1 ,y 2 ) defines the property SET^ for n € N. 
(II) There is a procedure which given n € N computes SET within 
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tlme polynomial in n and space linear in n. 



Proof : One can easily write down SET using FULL and 0RD . D 



Note that by Leans 3.5, FULL (x) is satisfiable in any P-structure. 



Hence, the formulas FULL and ORD^ allow us to write formulas which, no 
matter which P- structure they are interpreted in, talk about an ordered 



set of sise f(n + 1). Using DIS^ w« can talk about two members of 
this ordered set being f(n) apart. Using SET we can talk about all 
subsets of this ordered set and refer to the basic set- theoretic relations. 
In what follows we will think of a subset of this ordered set as 
corresponding to the binary string which is the characteristic sequence 
of the subset. It will be useful to be able to express the property that 
such a binary string begins in a particular way. 



* 
Definition 3.15 : For every y € {0,1} let START (x,y,e) be the property 

such that if n = |y| , S 6 P, a r b,c *€ N, then S h STittX <a,b,o) iff 

1) S V FULL (a) 
n 



Let(2)be the ordering determined on fb' f & h ORD (a.b* .b 1 )} by ORD 

n J n* 

Let a be the characteristic sequence (with respect to @ ) of the set 

(b« | Sh SET n (a,b,b')} - (b* | »l-CRD n (a,b',b') and »J- ORD^b.b' ,b')} , 

i.e., a is the binary string of length f(n + 1) determined by b, a and S. 
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2) a = yO " n «6 for some 8 € {0,1} of length f(n + 1) - f(n). 

3) c is the n + 1 smallest member (with respect to <§P ) of the set 
{b 1 | SKJRD (a.b'.b 1 )}. 



ji. 

Lemma 3.16 : Let y € {0,1} , |y| = n, and let i € {0,1}. Let § € P and 
let a,b,c € N. Then S W START (a,b,c) » the following eight properties 
hold for some a'.b'.c 1 (E N. 

1) S *" FULL iH _ 1 (a). 

2) S V- FULL n (a') 



Let (§) be the ordering determined on {c" | S|-ORD -(a,c",c"} by 
ORD .. Say that c ,c_, ..., c_., .. are tn « first f(n + 1) elements 
in increasing order (with respect to (§)). Let @ be the ordering 
determined on {c" | S*"0RD (a',c",c")} by ORD . 

3) {c" | St-0RD n (a',c",c")}= {c 1 ,c 2 , ..., c f (n+1 • Furthermore, 
Cj <H) c j_ for U j < f(n + 1). 

4) S»- SET n+1 (a,b,c ) » 3^ SET^a'.b'.c ) for 1 £ j £ f(n + 1). 

5) S*- START (a'.b'.c'). 

6) ShSET 1 (a,b,c') « i = 1. 

7) c is the immediate successor of c' in the ordering (§1 

8) S does not satisfy SET +1 (a,b,c") for any c", o@c ll ®c ff j.. 
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Proof : (3) says that the ordered set of sise f (n + I) determined by 

ORD and a' (and S) is the sane as the first f(n + 1) elements of the 
n 

ordered set determined by ORD. . and a. 4) therefore says that the 

n+1 

binary sequence of sise f(n 4- 1) determined by SET and a 1 and b* is 

the same as the first f(n +1) elements of the binary sequence of sise 
f(n + 2) determined by SET . and a and b; 5) and 6) say that this 

sequence of length f (n + 1) begins with yi and 8) says that the rest of 
it is 00... . 7) says that c is the n + 2 smallest member of the 
ordered set determined by ORD . - and a. □ 



Lemma 3.17 ; For every y € {0,1} there exists a formula of £ 

START (x.y.s) such that 

* 
(I) START (x.y.z) defines the property START for y € (0,11 . 

4. 
(II) There is a procedure which given y € {0,1} computes START 

within time polynomial, in |y| and space linear in |y|. 



Proof : Let START^ (x,y,z) be the formula as'(p(s,s') - x a z 4 z') f 

Lemma 3.16 shows that START . can be expressed in a fixed way (depending on i 

but independent of y ) using START , together with FTJLL .., FULL . ORD . , , ORD , 

SET .,, SET , and DIST,- where n ■ lyl. All of these latter properties can be 
n+1 n iH-1 

expressed in a fixed way from ORD , and so START . can be expressed in a 
fixed way from START and ORD . In order to conclude Lemma 3.17, 
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we have to use a more powerful theorem from Appendix 1 than that used in 

the proof of Lemma 3.9. Since for all n € N, ORD^ can be expressed in 

a fixed way from ORD , we can appeal to a special case of Theorem A. 9 

n 

in Appendix 1 (in which F^ - F|) to conclude Lemma 3.17. □ 



Remark 3.18 : For y € {0,1}* let START' (x,y) be the property such that 
Si- START* (a,b) « for some c, »V- START (a,b,c). We will really only use 
the fact that we can write short formulas defining the properties START^; 
the reason we have dealt with the more complicated START was in order 



to be able to express these properties inductively. 
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Sectlon 4; Using Formula* to Simulate Turin* Hachines 



In this section we will use the formulas FULI,, QRD . 

DIST , SET. , START to talk about Turing machines which recognise 
n ' n * y 

languages € NTIME(f(n)), and hence prove Theorem 1.2. 



Theorem 1.2 : NTIME(f(n)) ^ »TH(C) for any nonempty collection C of 
P-structures. 



Proof : Let 38 be a nondeterministic £-Turing aachine which operates 

within NTBffi(f(n)). In order to prove Theorem 1.2 we »peclfy in 
detail (partly reviewing from Chapter 1) the nature of our Turing 

machine. The tape alphabet is £, tf € E, and 38 has one head and one 
tape where the tape is one-way infinite to the right; initially the head 
is on the leftmost square of the tape and 38 never tries to read off the 
tape. If w € £ , then we input w to 3R by having the initial tape contents 
be wW... . Let the state set of 38 be {1,2, ..., k) where 1 is the initial 
state and k is the accepting state. W accepts w if there is some 
computation starting on wW... such that 38 eventually enters state k. 
Let us assume that after entering state k, 38 thereafter stays in state k 
without moving the head or changing the tape contents. Since 38 operates with- 
in NTIME(f(n)), if TO accepts w then there is some computation of 38 on 
w which enters state k within f(|w|) steps and hence without leaving the 
first f(|w|) tape squares. 
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Let w € £ + , |w| = n. Let g(n) = f(n + l)/f(n); g(n) a f(n), so 
if 331 accepts w there Is some computation which accepts w within g(n) 
steps. Consider now a particular computation of SK on w which goes for 
g(n) steps without leaving the first f(n) squares. Let W. € L of 
length f(n) be the contents of the first f(n) tape squares at time i 
(where 3J? begins at time 0). Let U, € {0, 1, 2, ..., k} of length f(n) 
be such that V ± = q j o f ^" q ~ 1 where at time i,2R is in state j and the 
head is pointing at square q (where the leftmost tape square is square 0). 

Let W = Wj/Wf. ,.«W , . , andU = U n «U, ... -U , . . so that 
1 g(n>l 1 g(n)-l 

•it 

| W | = |u| = f(n + 1). Define the marking string M € {0,1} of length 
f(n + 1) by M = (1 o f(n)_1 ) 8(n l We will call (W,U,M) the computation 
triple of the computation (on w). (W,U,M) is an accepting computation 
triple if k appears in U. Clearly 331 accepts w if and only if there is an 
accepting computation triple for w. 

Let (W,U,M) be a computation triple for w € 2/ , |w| = n. For any 
string y» l et Y(i) De tne i + 1 member of y so that 
W = W(0)»W(1). ... «W(f(n + 1) - 1), etc. For every j, £ j < g(n), and 

every i, 0^i< f(n), the values of W(j.f(n) + i) and U(J«f(n) + i) tell 
us the contents of square i and whether or not the head is pointing at 
square i (and if so, then the state of SK), at instant j. The rules 
(of the finite state control) of 331 together with the fact that we only 
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consider computations which do not leave the first f (n) tape squares 
put constraints on the values of W,U, and M around place 

j-f(n) + i + f(n) (if j«f(n) + i + f(n) < f{n + 1) ), depending on the 
values of W and ¥ at J*f(n) + i^ 

For instance, say that ' £ k < k + f (n) < f (n + 1), Say that 
W(k) - and U(k) ■ 5 and say that if SB is in state 5 with the head 
pointing to a square containing 0, then the machine is allowed to 
print 1 and move the head te the right and transfer to state 7; it is 
permissible therefore that: W(k + f(n» .,- 1 and U(k + f(n)) - and 
U(k + f(n> + 1) - 1 and M(k + f(n) + 1) 4 1. If U(k) » 0, then we 
must have W(k + f(n)) - W(k). The point is that there are only certain 
values of (W(k), B(k>, »<k + ffci)>, ©(k + f<n) - 1), B(k + f(n», 

U(k + f(n) + l>,K(k + f(n) + 1)) 
which are permissible, i.e., consistent with St . These ideas are developed 
rigorously in [St©74, Section 2.2], 



Lemma 4.1 : Let W € £*, U € {0, 1, 2, ..., kj , M € .{ft, 1} he Strings 
of length f(n + 1). Then (W,U,M) is an accepting computation for 

w € {0,1} , |w| » n, if and only If 

it 

1) M € 1*{0,1] and every contiguous f(n) symbol Of M contains exactly 

one 1. 

«v „ ,- -#f (n)»-n -,* 

2) W e w*lr *L . 

3) U € I-O**"*" 1 ^©,!, .... k}*. 

4) For 0«i< f(n + 1) , if K(i? » 1, then exactly o&t of the numbers 
U(i), U(l + I), ..., B(i + f(n) - 1) ie noasero. 
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5) For all i such that 1 £ i < i + f(n) < f(n + 1), the value of the 7-tuple 
(W(i), U(i), W(i + f(n)), U(i + f(n) - 1), U(i + f(n)), U(i + f(n) + 1), 

M(i + f(n) + 1)) is consistent with TO . 
and 

6) U contains an occurrence of k. 

Proof : 1) through 6) say roughly that W and U begin with the right 
configuration, that the transition between any two successive; configurations 
of length f (n) (marked off by M) are permitted by the rules of % and 
that the accepting state appears in U. These are necessary and sufficient 
conditions for (W,U,M) to be an accepting computation for w. □ 

Completion of the proof of Theorem 1.2 : Let w € E , |w| = n. We have 
shown that with formulas of length proportional to n we can talk about 
an ordered set of size f(n + 1). Every subset of this set can be 
thought of as a string of length f(h + 1) over {0, 1}. Every sequence 
y v Y 2 > •••» Y of v strings over {0, 1} of length f(n + 1) represents 
a string of length f(n + 1) over the alphabet (0,1} V (the set of v- tuples 
containing just 1 and 0), namely the string v where 

Y(i) = (^(1), YzC 1 ). •••» Y v (i)) f or s i < f(n + 1); if 

|LU {0, 1, 2, ..., k} | = 2 V , we can think of Y r y 2 » ..., y v as 

representing a string of length f (n + 1) over the alphabet 

LU {0, 1, ..., k} by coding £ U (0, 1, ..., k} into (0, 1} V . Say that tf is 

coded as(0,(V../>). Then the string w»f f(n '" n will be represented by 
v times 
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Y l » ^2 » •••» Y_0 tsfeare Y. € {0,1} and is of 

length n for 1 si s.v. 

t^.^ „*. b,^. ^. a^, is,, j^, « Bya m^ 

we can writ* a sentence F of length en ufetefe eaye Chat there exists 



(W,U,M) satisfying conditions 1) through 6) in 1,1m 4.1. that i», for 
any * € P, M^ mill -fee true 1m * if and only if P accepts w. Hence, if C 

Is a ttonempty collection of JMftseoc'tKtaa., T € tlrflC) • St accepts %. 

So L(3R) £ ,TH<C) . D 



■ US- 



References 



[Ch56] Church, A., Introduction to Mathematical Logic , I, Princeton, 1956. 

[Co73] Cook, S.A. , "A hierarchy for nondeterministic time complexity," 
J. Contput . Sygt . Sci . 7, 4 (Aug. 1973), 343«<353. 

[Cob72] Cobham, A., "The intrinsic computational difficulty of functions," 
Proc . Internat . Congr. Logic , Method, and Philos . Sci ., 1964, 24-30. 

[Coo72] Cooper, CD., "Theorem-proving in arithmetic without multi- 
plication," Comp . and Logic Group Memo 16,U.C. of Swansea, 
(April 1972). " 

[Ehr61] Ehrenfeucht, A, "An application of games to the completeness 

problem for formalized theories," Fund . Math . 49 , 1961, 129-141. 

[ELTT65] Ershov, Y. L. , Lavrov, I. A., Taimanov, A.D. and Taitslin, M.A. , 
"Elementary theories," Russian Math . Surveys . 20, 1965, 35-105. 



[Fer74] Ferrante, J., "Some upper and lower bounds on decision 

procedures in logic, "Doctoral Thesis, Dept. of Math., M.I.T., 
to appear 1974. 

[F1R74J Fischer, M.J. and Rabin M.0. , "Super -exponential complexity 
of Presburger arithmetic." Proc . AMS. Svmp . on Complexity of 
Real Computational Processes , 1974, to appear; also, MAC Tech . 
Memo . 43, M.I.T., 1974. 

[Fis73] Fischer, M.J., Personal communication. 

[FR74] Ferrante, J. and Rackoff, C. , "A -decision procedure for the 
first order theory of real addition with order," SIAM J. for 
Computing . 1974. to appear; also MAC Tech. Kemo . 33. (May 1973). 

[FV59] Feferman, S. and Vaught, R.L. , "The first order properties 

of products of algebraic systems," Fund . Math . 47. 1959, 57-103. 

[MB68] Maclane S. and Birkhoff, G. , Algebra . Macmillan, 1968. 

[Men 64] Mendelson, E. , Introduction to Mathematical Logic , Van Nostrand 
Reinhold, 1964. 

[Mey73] Meyer, A.R. , "Weak monadic second order theory of successor 
is not elementary-recursive," Boston Univ . Logic Colloquium 
Proc ., to appear 1974; also MAC Tech . Memo 38 , M.I.T. , 1973. 

[Mos52] Mostowski, A., "On direct powers of theories," J. Symb . Logic 
17, 1952, 1-31. 



■116- 



[MS72] Meyer, A.R. , and Stockmeyer, L.J., "The equivalence problem 
for regular expressions with squaring requires exponential 
space," Prpc . 13 IEEE Svmp . on Switching and Automata Theory , 
1973, 125*129. 

[Opp73] Oppen, B.C., "EKanentary bounds for Presburger arithmetic," 
Proc . 5th ACM Symp . on Theory of Computing . l$t$, 34-37. 

[Pet67] Peter, R. , Recursive Functions . Academic Press, 1967. 



[Pre29] Presburger, M. , "Uber die Vol 1 stand tgkei t eines gewissen 

Systems der Arithmetik ganaer Zahleh, in welchea die Addition 
als einzige Operation hervortritt," Comptsa Rendus, I Consres 
de* Math , 4e» Pays Slaves . Wax*aw, 1929, 192-201, 395. 

[Rob73] Robertson, E.L., "Structure of complexity in the weak monadic 
second-order theories of the natural numbers," Research Report 
CS-73-31 . Bept. of Applied Analyst « «ttd Computer Science, 
Univ. of Waterloo, (Dec. 1973); alio "££$£. §& AGJS SHE* SE 
Theory of Computing. 19 74 161-171. 

[Rit63] Ritchie, R.W., '•Classes of predictably computable functions," 
Trans . AMS 106. 1963, 139-173. 

[Sav70] Savitch, W.J. , "Relationships between nondeterministic and 
deterministic tape complexitiTes,^ J. Coaput . Syst . S£i. 4, 
2 (April 1970), 177-192. 

[Sei74] Seiferas, J., "Nondeterministic time and space complexity 
classes," Doctoral Thesis, Dept. of Elect. Eng., M.I.T.. , 
to appear 1974. 

[SFM73] SelferaS, J., Fischer, M.J., and Meyer, A.ft. f "Refinements 
of the nondeterministic time and space h^wiraxcftlis," Proc . 
14th IEEE Sv»p . oft Switching and Automata Zkmtom ' 1973 , 130- 137 . 

[SM73] Stockmeyer, X. J., .and Meyer, A.R., ••Wbrd ipjroblems requiring 
exponential time: preliminarv raport,** Proc . 5th ACM Symp . 
SS Theory of Computing. 1973, 1-9. 

[Sol73] Solovay, R. , Personal communication. 



-117- 



[Sto74] Stockmeyer, L.J., "The complexity of decision problems in 
automata theory and logic/' Protect HftC Tech . R eport 133. 
1974. 

[Szm55] SzmielenW "Elementary properties of abelian groups," Fund . 
Math. 41, 1955, 203-271. 

[Ten72] Tenney, R.L., "Decidable pairing functions," Dept. Comp. Sci., 
Cornell Univ., Tech. Report 72-136, 1972. 

[Ten74] Tenney, R.L. ."Decidable pairing functions," to appear, 1974. 

[Ten74'] Tenney, R.L. , "Second-order Ehrenfeucht games and the 

decidability of an equivalence relation," to appear, 1974. 



-118- 
Appendix 1 - w^Mfg Short Foiaaules for Ind uctively Defined Properties 

Let £ be the language of the first order predicate calculus with a 
finite number of relational symbols R^, B-j, ..,, ft^. Let P be a 

class of structures for £. Henceforth all properties and all 
equivalences between formulas of X will be with respect to P. The 
purpose of this appendix is to prove that one can construct short 
formulas defining certain inductively described properties. 

Theorem A. 2 below will essentially say the following: given a 
sequence of properties G Q , G , ... such that G Q is defined by a formula 

of X and such that G ± . can be expressed in a fixed wsy (independent of i) 

from G. using the language £, then for every i > there is a formula of 
£ of length proportional to i which defines the property G ± . 

We assume for convenience that equality is definable in P, and 

hence for convenience assume that v., = v„ is an atomic formula of £. 

We also assume that every structure in P has a domain of cardinality 

£ 2. 

Now let k € N be fixed and let £' be the language of the first order 

predicate calculus which is the same as £ except that a k-place formal 

t 
predicate ft, has been added. 

T ~ ~~ 



Two formulas of £' are equivalent if they are equivalent in any structure 
obtained by adding to a structure from P an interpretation for ft. 
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Definition A.l : Let F(x.) be a formula of X' and let G(x^) be a 
property. We define an infinite sequence of properties, 

G Q (^), G 1 (^ k ), ... as follows: Let G Q {\) be G^). For every i € N 

— k 
and for every structure S € P with domain S and for every a^ € S , we 

say that S h G.^C*^) iff S I- FO^) when the formal predicate ft is 

interpreted in S as G. (restricted to S). 

Theorem A. 2 : Let F(x.) be a formula of X 1 and let G(x^) be a formula of 
X defining the property G^). Let G^x^), G 1 (x fc ), ... be the 
properties defined in Definition A.l. Then there exists a sequence 
Go CO i G x (0» ••• of formulas of X such that 
(I) G. defines the property G ± for each i 6 N. 
(II) There is a procedure which given if N computes G^ within 
time a fixed polynomial in i and space linear in i. 



Theorem A. 2 is due to Fischer and Meyer [cf. FiR74], working from 
earlier ideas of Stockmeyer [SM73], A key part of the proof will be 
Lemma A. 3. 
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Lemma A. 3 : Let F be a formula of £'. Then there exists a formula F» 
of £' equivalent to F such that F* has exactly one occurrence of the 
predicate letter R ; this occurs in an atomic formula in which all the 
k formal variables are distinct. 

Proof : Let F be a formula of £' . Since any formula of £' can trivially 
be extended to an equivalent one with at least one occurrence of R, 
assume that F contains at least one occurrence of R. Assume F is in 
prenex normal form so that F looks like Qi v jQ2 v 2 *•• ^j v j^ wher * £ is 
a quantifier free formula containing m ^ 1 occurrences of the symbol R 
and where v.,v ? , ... ,v T represent formal variables. Let us say that the 
m atomic formulas of A in which R occurs, from left to right are 
R_ (v ll' v 12» .... v lk ), R (v 21 ,v 22 v 2fc ), .... ^(v^.v^, .... v^) 

where the symbols v. for 1 £ i ^ m and 1 £ j £ k represent formal 

*-» J 

variables. 

Let y-, y', y 2 , yl, ...,y ,y' be distinct formal variables not 

appearing in A. Let A' be the formula obtained from A by replacing 

R(v..,,v i2 , ..., v..) by y. = y' for 1 £ i £ m. Since in every structure 
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of P there are interpretations of y and y' which cause the formula 

y = y* to be true, and interpretations which cause y = y 1 to be false, 

we see that A is equivalent to 

By^y • 3y 2 3y£ . . . 3y Hy^A' A A [ fy ± = y\) *+ ^ iV v i2 v ik ) ] ) * 

l^i^m 

Now let y, y 1 , s.,z., ..., z. be distinct formal variables not 

occurring in /> [(y. - y') *•> *< v n ,v.«, v..)]. 

l*i*m X l " 1K 

^ [(y ± »' yj)«* ^ (v ii» v i2' *••' v ik )] is •fl«i v *i» t ' to '- 

l£i£m 

VyVy'Vz 1 ...Vz fc t(Ns/ (y = y ± A y' = y • A z ± - v n A * 2 " V i2 A * ' ' A *k = V ik }) 
l^i^m 

((y = y»)4»R(z lt E 2 , ..., * k ))]. 

So we have shown that F is equivalent to a formula; with exactly one 
occurrence of ft, which occurs in the atomic formula ft/a^). □ 



Definition A. 4 : Let F(x. ) be a formula of Z and let z^z^ ..., z fc be 

distinct variables all of which are different from x.,*,, ..., x^. 

(i fcl*k> 
Then let F (z.) be the formula obtained from F in the following way: 

If v is an occurrence (not necessarily free) of a formal variable in F, 

then if v = z for some i, 1 £ i £ k, replace v by x. ; if v = x. for some i, 
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1 s i s k, replace v by z^. 

Definition A. 5 ; If F is a formula of £, define the fjze of F, s(F), to 
be the length of £ When each variable subscript is counted to be of 
length 1 and all other symbols are counted normally. 

The following lemma follows immediately from the definitions. 

<\\<) - 
Lemma A.6 : Let J^) *nd F. (s k ) be as in Definition A»4. 

Then s(F) = s(F ), and J.^) and F (t^) define the same 

property. 

Proof of Theorem A. 2 : Let E(\) be a formula of £' and let G^) be a 
formula of £ defining the property GO*^). By Lemma A. 3 assume that F 
contains exactly one occurrence of 8; the proof of Lemma A.3 assures us 
in fact that we can insist that the atomic formula in which ft Occurs is 
ft 00 where s., z„, ..., z are distinct variables not occurring in 

{ x. , t^2 » • • • » ■ x j c ) • 

Now define a sequence <L)(x. )» GjOO, ... of formulas of £ as follows. 
Let Gq be G. For all i € N, let G. +1 be the formula obtained by 
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substituting fi. for £(0 in F« It is easy to see by induction 

(using Lemma A. 6) that S^C^y) defines G ± (\) for each *• € N « 

(I k'V 
For c = |f| we have sCG^) * c Q + s^ * ) = c Q + sC^) 

for i € N, so s(Gj ^ s(G) + i*c . Every variable occurring in each G^ 

is either from the set {x.,x 2 , ..., x.} or occurs in F or occurs in G. 

If c. is the maximum length of any such variable subscript, then 

|g.| < c.'s(G,) ^ c.'(e(G) + i*c ) ^ c-i for i € N and some constant c 

independent of i. It can also be checked that one can compute G. 

within time polynomial in i and space linear in i. D 

Remark A. 7 : Theorem A. 2 can be improved in a number of ways. Firstly, 
we can obtain our result even without the restrictions that equality be 
definable in P and that every structure in P have a domain of cardinality 
a 2. In addition, using a trick suggested by Solovay [Sol73] we can obtain 
the same result even if our language of the predicate calculus doesn't 
contain *•* . 

Theorem A. 2 can be generalized in a number of ways. We will only 
present the particular generalization which we need in the text. 

To begin with, let Z" be the language of the first order predicate 
calculus which is the same as £ except that we have added two new formal 
k-place predicates: ft and ft' for some fixed k € N. 
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Definition A. 8 : Let ZqO^) , I]^)* ^0 ( V' -1 ( V be fonBula8 of * M ' 

Let G(x. ) and G'(y7) be properties. For every y € {0,1} we let 

G (x, ) and G'(yV) be properties as follows: If V is the empty string, 

Y K Y K 

let G^ be G and let G' be G'. For every 5 € {0,1] and every 

— k 
S 6 P with domain S and every a^ € S we say 

5 I- G^Ca^) (where i € {0„1$ iff S t- ^(a^) when ft is interpreted as 

G, (restricted to 3); and ft' is. interpreted as G£* we say * h- G^^) **i 

S h F!(aV) when ft is interpreted as G fi and ft* is interpreted as,6g. 

Theorem A, 9 : Let f^Fj^Fj be formulas of I" and let G^), G • (y" k ) 
be formulas of £ defining, respectively, the properties G(x fc ) and 
G'(y k ). For each y € {0,1} , let G y (\) and G'Cy^) be as in Definition 
A. 8. Assume that for any S € P, the relations obtained by restricting 
G and G' to 8 are both nonempty. Then for each y € (0,1} there exist 
formulas G (x^) , G* <y fc ) such that 

(I) G defines G and G' defines G'. 
~Y Y ~Y Y 

(II) There is a procedure which given Y € {0,1} computes G^ and G'^ 
within time a fixed polynomial in |y| and space linear in \y\. 
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Proof: The basic idea of this proof is what we call "simultaneous 

definition"; for every y 6 {0,1} we will write down a formula which 

defines both G and G', as described below. 
Y y 

For each y» let H v ( x j c »y fc ) D * a 2k-place property which We define 
informally to be "G 0^) A G'^)"; more formally, if * € P with domain 
S and a^, b" k € S k , then we say 3 I- H (a^.b^) •» » h G (aV) and 
S H G 7 ( V ' The f ormula Sx.(\»y k > B £(^) A G ' (y k ) defines H x (\,V k ) • 

Let 6 6 {0,1} and let i € {0,1}. We now show informally (this will 

be made precise below) how H.. can be expressed from EL: It is sufficient 

i 01 o 

to show that G. . and G' can be expressed from H.. Using F. and F! we 
can express G fii and Gl. by using G. and G'. Since for any 5 € P 

with domain S and any a. € S , 

» H G 6 (\) « for some \ 6 S k , 8 h H^,^), and 

S h G^Ca^) *» for some b" k € S k , S h MVV'* we see that G g and G£ 
can be expressed from H. . 



Proceeding more formally, let £" be the language of the first order 



since the relations obtained by restricting G. and Gl to S are nonempty. 
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predicate calculas obtained from £ by adding a 2k-place formal predicate 1J. 

Let w.,w 2 w. be distinct variables not occurring in F ,I 1 fF' »£j_« 

For i € {0,1} , let 9 (xj be the formula of JEJ obtained from F^ by 

substituting Sv^v^ ... , Sw^ fiCv^^) for ft (v fc ) -every time ft appears 

(where v.,,v 2 , . .., v. represent formal variables), and substituting 

aw.3w 2 ... 3w. U (v fc ,v k ) for ft ' (v. ) every time ft ' appears; obtain 

&\ (y% ) from F! in the same manner. 
— i VJ lr — i 

For i € {0,1}, define the formula T^x^y^) of Hjj as 

_ _ ^ 

y (x. ) A ^i(y k )« One can now see that for 6 € {0,1} , i € {0,1}, 

S 6 P with domain S, and a^.b^ 6 S k , we have 8 I- G^O^) »SH ^(\) 
when U is interpreted as Hg restricted to *, S H G^O^) »8h Z[0> fc ) 
when U is interpreted as H. restricted to 3, and therefore 
3 h H. (a. ,b.) »8l- Ii(*v»\5 when ^ is Interpreted as H g restricted to S. 
Now let {z-.z,,, ..., « 2fc } be a set of 2k distinct variables not 

intersecting {x.,x 2 x k» y l' y 2' **** y k^ or the 8<St ° f variables in 

T Q and T . Let EnC^yi,) a" 4 -i(*k» y ir) be fonnula s of £|J such that each 
contains exactly one occurrence of U, namely in the atomic formula H('2k^' 
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and such that T-. is equivalent to T_ and £ is equivalent to T.. 
For every y € {0,1} define the formula H (Xj-.yi,) of £ * s follows. 
Let S^CXj^.y^) be, as before, the formula £0^) A £'(y k ); for 6 € {0,1} 
and i € {0,1}, let H. be the formula obtained by substituting, for 
U(z- ) in T , the formula JL . It is now easy to see that 

H (x^*^) defines H (x.,y" k ) for -y € {0,1} . As in the proof of 
Theorem A.2, we can check that |h | £ c|y| for IyI > 0. Lastly, for 
Y € {0,1}*, let G^) be By^ ... Sy^C^,^) and let G^ be 
3x-3x„ ... 3xjH (X|_,y.). It is clear that conditions (I) and 
(II) of Lemma A.9 hold. H 
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Appendix 2: Notation 

The empty set. 

A-B {x|x a and x I B] (set difference). 

P(A) The set of all subsets of the set A. 

|a| The cardinality of the set A. 

\a\ The length of the string a. 

| n | The absolute value of the integer n. 

£* The set of all strings over S if £ is a finite alphabet. 

\ The empty string. 

zf s* - m . 

oty or o>y Concatenation of the strings a and y. 

d(i) The i + 1 (from the left) member of the string Of. 

a k If a is a string, then «.<*• ... •<* (k times) if k > and \ if k - 0. 

s k If S is a set, then S X S X . . . X S (k times) if k > and If k-0. 

^ (a x ,a 2 , .... a fc ) if k > and if k = 0. 

(e,e, .... e) (length k) if k > and <4 if k = 0. 

k (e.e, .... e) (length k) if k > and if k = 0. 

Max A Maximum of the set A. 

Min A Minimum of the set A. Min A = if A = 0. 

log n log2 n « 

f is 

one-one f(a) = f(b) '=» a = b. 

f is 

onto B For all b € B there is some a such that f(a) * b. 

N The set of nonnegative integers. 

Z The set of integers. 

r The set of real numbers. 



k 

e 



e 
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IN 

Z 

F 

8 
* 

s 

* 

s 

8 
n 



n 


pa mod k 


M(n,k) 


TH(S) 


TH(P) 


S h F 


Ma|| 


FAG 


TO 


LCTU) 


Si 


DTIME(f(n)) 


NTIME(f(n)) 


DSPACE(f(n)) 


NSPACE(f(n)) 



The structure < N, +, £, >. 

The structure < 2, +, £, >. 

The structure < R, +, £, >- 

A logical structure with domain S. 

The weak direct power of 8. 

* 
The domain of S . 

The strong direct power of 8. 

The Ehrenfeucht equivalence relation (definition 2.2.1). 

Equal up to size n (definition 2.3.2). 

Equivalence mod k. 

k 
The number of ■ equivalence classes on S . 

The set of sentences true in 8. 

The set of sentences true in every structure in the set P. 

F is true in 8. 

The norm of the element a of a logical structure. 

Finite abelian group. 

A (one tape, one head) Turing machine. 

A language recognised by 3JU 

Polynomial time, linear space reducibility. 

The set of languages recognizable within time f (n) by a 
deterministic Turing machine. 

The set of languages recognizable within time f(n) by a non- 
deterministic Turing machine. 

The set of languages recognizable within space f (n) by a 
deterministic Turing machine. 

The set of languages recognizable within space f (n) by a non- 
deterministic Turing machine. 
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